vaheeD khoshnouD

Objective

1. All users in general category would get maximum download speed(HTTP and/or P2P) @ 8 Mbps from Cache.

2. All users in 16M category would get maximum download speed (HTTP and/or P2P) @ 16 Mbps per file download instance from Cache.

3. All users in 12M category would get maximum download speed (HTTP and/or P2P) @ 12 Mbps per file download instance from Cache.

4. Multiple download instances on one single user from the cache would share his own download speed quota(8M/12M/16M) among download instances.

5. In this example the individual user 192.168.100.1 and all the users in network 192.168.220.0/24 would have 12 Mbps speed for cache hit (HTTP and/or P2P) from Cache.

6. Also, the individual user 192.168.200.1 and all the users in network 192.168.210.0/24 would have 16 Mbps speed for cache hit (HTTP and/or P2P) from Cache.

7. All other users of 192.168.100.0/24 and 192.168.200.0/24 networks would have to be considered in general category to have speed quota @ 8 Mbps for for cache hit

(HTTP and/or P2P) from Cache.

Assumptions

1. IP address of the cache is 192.168.248.14.

2. HTTP proxy in the cache runs in ‘hidden’ mode. Meaning it spoofs the ip address of the subscribers while sending requests to the servers. Therefore the servers do not detect the presence of the http proxy.

3. HTTP cache hit traffic is marked with DSCP=4 in the Cache. Meaning all traffic through MiktoTik with DSCP mark 4 are considered HTTP cache hit.

4. P2P cache hit traffic is having a source IP address as that of the cache. Therefore, any traffic through Mikrotik that has source IP address= 192.168.248.14 is considered as P2P cache hit traffic.

Solution

Static Simple Queues won’t work. Because, if the ISP has few thousand users, there should be that many simple queues defined. This is fairly impractical. Also, static simple queues would not support dynamic assignment of IP addresses to subscribers.

We need to use dynamic simple queues along with PCQ. This would create thousands of dynamic sub-queues for thousands of subscribers automatically.

Network Diagram

[Internet]
    |
    |
    |
    |
[L-3 Switch]--------[Mikrotik in bridge mode using ether2 and ether3]---------[HTTP &P2P Cache]
    |                                                                                                                        
    |     
    |
    |
[Subscribers]

=======
Subscribers' subnets in this example: 192.168.100.0/24; 192.168.200.0/24; 192.168.210.0/24; 192.168.220.0/24

Bridge

1. Create a bridge named bridge1

/interface bridge 
add name="bridge1"

2. Add interfaces ether2 and ether3 to bridge1

/interface bridge port 
add interface=ether2 bridge=bridge1 
add interface=ether3 bridge=bridge1

3. Configure bridge1 to use ip firewall so that packet marking works.

/interface bridge settings
set use-ip-firewall=yes

Address-List

1. Add address of Cache servers to the address-list P2P_Cache

/ip firewall address-list
add address=192.168.248.14 disabled=no list=Cache

2. Add host/network Addresses to address lists P2P_Client_12M or P2P_Client_16m for 12 Mbps or 16 Mbps download speed quota.

add address=192.168.100.1 disabled=no list=Client_12M
add address=192.168.200.1 disabled=no list=Client_16m
add address=192.168.220.0/24 disabled=no list=Client_12M
add address=192.168.210.0/24 disabled=no list=Client_16m

Connection Tracking

1. Enable connection tracking for PCQ to work. TCP-established timeout has been reduced from default 1 day to 1 hour.

/ip firewall connection tracking
set enabled=yes tcp-established-timeout=1h

Mangle

1. All the packets with source IP address equal to the IP address of P2P interface on CacheMARA needs to be classified by packet marking into 12M, 16M or General

classes.

/ip firewall mangle

add action=mark-packet chain=prerouting comment="HTTP Cache Hit Packet Mark for 12M Clients" 
dst-address-list=Client_12M new-packet-mark=Cache_Hit_12M passthrough=no dscp=4

add action=mark-packet chain=prerouting comment="P2P Cache Hit Packet Mark for 12M Clients" 
dst-address-list=Client_12M new-packet-mark=Cache_Hit_12M passthrough=no src-address-list=Cache

add action=mark-packet chain=prerouting comment="HTTP Cache Hit Packet Mark for 16M Clients" 
dst-address-list=Client_16M new-packet-mark=Cache_Hit_16M passthrough=no dscp=4

add action=mark-packet chain=prerouting comment="P2P Cache Hit Packet Mark for 16M Clients" 
dst-address-list=Client_16M new-packet-mark=Cache_Hit_16M passthrough=no src-address-list=Cache

add action=mark-packet chain=prerouting comment="HTTP Cache Hit Packet Mark for All Clients" 
new-packet-mark=Cache_Hit_General passthrough=no dscp=4

add action=mark-packet chain=prerouting comment="P2P Cache Hit Packet Mark for All Clients" 
new-packet-mark=Cache_Hit_General passthrough=no src-address-list=Cache

Per Connection Queuing

1. Different PCQs for 12M, 16M or general class need to be created.

/queue type
add kind=pcq name=8Mbps pcq-rate=8M
add kind=pcq name=12Mbps pcq-rate=12M 
add kind=pcq name=16Mbps pcq-rate=16M

Simple Queue

Create simple queues for different speed limits.

/queue simple

add comment="HTTP P2P Cache Hit @ 16 Mbps" name=HTTP_P2P_16 packet-marks=Cache_Hit_16M queue=16Mbps/16Mbps

add comment="HTTP P2P Cache Hit @ 12 Mbps" name=HTTP_P2P_12 packet-marks=Cache_Hit_12M queue=12Mbps/12Mbps

add comment="HTTP P2P Cache Hit @ 8 Mbps" name=HTTP_P2P_8 packet-marks=Cache_Hit_General queue=8Mbps/8Mbps