ISP Throttling

FTLN

Active member
Hi guys, does anybody know if there is a specific test that I can do to see if my isp is throttling my torrents, youtube, etc..

Sometimes in the day youtube is great but other times it is terrible and i have to buffer for a couple of minutes..... I can do a speedtest and I have around 2000kb/s download and 100kb/s up...

Torrents are the same capping randomly at 1100kb/s and then sometimes they go full throttle at 2000kb/s

My isp is Orange France and they have denied in recent media reports that they throttle certain services... They even have said that youtube problems are due to youtube not having enough bandwith to serve videos but I dont beleive this for an instant..

Was watching ttl's subscriber video today and I had to let it buffer for around 15 minutes and that was at 480p... I did a speed test whilst it was buffering and I was hitting 2000kb/s but the youtub e vid was coming in at like 10kb/s !!
 
Are you sure that your ISP doesn't have some sort of Fair Use Policy/Traffic Management?
In UK I'm using Virgin Media 100MB and they have a Fair Use Policy where if you download more than 4.5GB in one hour or 5750MB in two hours between 4PM - 11PM they will throttle your connection by 30% for one hour or until you fit in their thresholds or the traffic management time ends.
You can try Glasnost and/or ShaperProbe and see. Not sure how effective are they though. Link Removed

Also I had problems with youtube as well. The issue was caused by slow Virgin Media cache servers and sometimes by slow youtube servers. I ended up blocking the IPs of these slow servers and most videos were working just fine, but in the end it seems that they fixed it.
You could try ProxMate addon in Firefox for youtube, it might connect you to better servers but I'm not entirely sure about that.
 
Last edited by a moderator:
.................
In UK I'm using Virgin Media 100MB and they have a Fair Use Policy where if you download more than 4.5GB in one hour or 5750MB in two hours between 4PM - 11PM they will throttle your connection by 30% for one hour or until you fit in their thresholds or the traffic management time ends
...........

I've been looking for this, for a long while now.... is this official, in the small print somewhere?

back to the question though, take a look in your broadband terms and conditions for any similar reference to traffic calming measures...you might find that this is indeed the case....
 
There is nothing about fair play in my contract.. I pay 50 euros a month for internet and telephone "Unlimited" ... I'm currently running the glasnost test to see if any traffic shaping is occuring...

If this is happening is there a way to get around it ? Maybe like bypassing cache servers or changing my dns server ?

Edit, here are my youtube results on glasnost.. seems strange that it says my upload is too noisy, I have no other apps active...

Is your upload traffic rate limited?

There is no indication that your ISP rate limits your uploads.

Is your download traffic rate limited?

The measurement data is too noisy to detect whether your ISP rate limits your download traffic. Re-running the test while ensuring that no other downloads or uploads are running in the background might fix this problem.


You can view the detailed measurement results of the test here.
For more details on how Glasnost tests work, please read our NSDI 2010 paper.

MPI-SWS
Glasnost: Test if your ISP is shaping your traffic

Detailed test results giving the throughput per flow Glasnost runs:
All FlashVideo and control flow transfers using port 8080

Transfer Direction Bandwidth FlashVideo flow Bandwidth control flow

Download #1 7425 Kbps 6752 Kbps
Download #2 8196 Kbps 7780 Kbps
Download #3 11213 Kbps 6193 Kbps

Upload #1 814 Kbps 802 Kbps
Upload #2 813 Kbps 813 Kbps
Upload #3 804 Kbps 817 Kbps



All FlashVideo and control flow transfers using port 38221

Transfer Direction Bandwidth FlashVideo flow Bandwidth control flow

Download #1 8706 Kbps 8471 Kbps
Download #2 10059 Kbps 8407 Kbps
Download #3 6908 Kbps 10997 Kbps

Upload #1 811 Kbps 805 Kbps
Upload #2 813 Kbps 817 Kbps
Upload #3 804 Kbps 818 Kbps



FlashVideo transfers using port 8080 and port 38221

Transfer Direction Bandwidth Port 8080 Bandwidth Port 38221

Download #1 7425 Kbps 8706 Kbps
Download #2 8196 Kbps 10059 Kbps
Download #3 11213 Kbps 6908 Kbps

Upload #1 814 Kbps 811 Kbps
Upload #2 813 Kbps 813 Kbps
Upload #3 804 Kbps 804 Kbps



Control flow transfers using port 8080 and port 38221

Transfer Direction Bandwidth Port 8080 Bandwidth Port 38221

Download #1 6752 Kbps 8471 Kbps
Download #2 7780 Kbps 8407 Kbps
Download #3 6193 Kbps 10997 Kbps

Upload #1 802 Kbps 805 Kbps
Upload #2 813 Kbps 817 Kbps
Upload #3 817 Kbps 818 Kbps





For details on our research on broadband networks please refer to our network transparency project webpage

In case you have questions about this tool or our research, please contact us: broadband @at@ mpi-sws org
 
Last edited:
I've been looking for this, for a long while now.... is this official, in the small print somewhere?
Link.

Try doing the test outside of peak hours or it may be that you are connected to an oversubscribed line and depending on how many people use it you may have speed losses.
Also for youtube you may want to check this thread. If you find that your ISP cache servers are slow(not throttling but just slow) you can just ban the IPs in your Firewall.
Bypassing cache servers won't stop them from throttling because they can still see where your traffic goes, the only way I know around throttling is to use a VPN service.
 
Are you sure that your ISP doesn't have some sort of Fair Use Policy/Traffic Management?
In UK I'm using Virgin Media 100MB and they have a Fair Use Policy where if you download more than 4.5GB in one hour or 5750MB in two hours between 4PM - 11PM they will throttle your connection by 30% for one hour or until you fit in their thresholds or the traffic management time ends.

They slow you down more than that if you continually trash the bandwidth mate. It's worth noting that they monitor what exactly you're downloading. If it's illegal content they'll throttle (if you take the piss), if not they'll leave you be unless they need to slow you down to accommodate near by customers on the same box (cant remember what the technical name is). Speaking to a VM engineer, he says we could use a proxy to get around them knowing what we're downloading, or just use the schedule feature in the torrent clients settings.
 
Last edited:
Looks like the problem lies with google for youtube

That's not how it works. Your ISP does not run the caching server. Google does.

You should not try to bypass video cache servers AKA CDNs. If everyone did that the internet would break.

Seriously. The reason those caches exist is to get video traffic off the internet as quickly as possible at the edge (where your ISPs router meets the start of the internet) and not congest the backbones the internet actually needs to transport non-static content.

If your video is slow to load the cache probably hasn't fully loaded yet, this happens often on NEWLY POSTED videos or videos that aren't played very often (because they just aren't popular). It's only after a certain number of plays and high demand that YouTube mirrors the videos to Google cache's around the world.

Google will cache all content (and removes it after a certain period of time if it's isn't requested anymore), some others like Netflix will specifically cache popular content.
But it's the same idea really, brand new content may be slightly slower than it would be from the cache.

Here's some documentation from a few years ago, it still works more or less the same though:

quote:
The explosion of broadband access and rich multimedia content continually increases the demand on service provider networks. Google Global Cache (GGC) allows you to serve Google content, primarily video, from the edge of your own network. This eases congestion on your network and lessens traffic on peering and transit links. GGC saves you money while improving the experience of your users.

System Overview

Without GGC, every user request for the latest YouTube video causes a unique copy of that video to transit your network, from Google to your user. With GGC, only the first copy of the video makes the transit. When another user requests that same video, Google serves it from your GGC node.

GGC Features

- Reduced traffic through your network

Cache hit rates vary with the usage pattern of your users, but typical performance is close to 75%.

- Faster response, transparent to users

Google transparently serves your users’ requests from caches inside your network.

- Easy to set up

Installation requires a rack, a laptop, a copy of our CD, and a connection to your network. Once the servers have been initially configured and are reachable, Google will do the rest of the work and monitoring remotely.

- Robust

The node has multiple levels of redundancy. If the GGC node is unavailable for any reason, user requests will be sent transparently to Google.

How GGC Works

When a user requests a piece of content – for example, a video, web page, or image – Google systems determine if that content can be served from the GGC node inside your network and if the user is authorized to access the GGC node.

If the GGC node already has the requested content in its local cache, it will serve the content directly to the end user, improving the user experience and saving transit expense.

If the content is not stored on the GGC node, the node will retrieve it from Google, serve it to the user, and store it for future requests.

Request Flow Diagram

Diagram Key

1. A user follows a link to a Google-hosted video or other content. The computer generates a DNS request for the IP address of the content host.

2. Your DNS resolver queries Google DNS for the IP address of the content host.

3. Google DNS knows that you have Google Global Cache, so it replies with the IP address of the node. It knows this because you have advertised the IP addresses of your DNS resolver to the node (via BGP) and Google has loaded that information into its DNS system.

4. Your DNS returns the IP address of the cache node to the user.

5. The user’s computer now sends the content request to the received IP address, which routes to your GGC node.

6. The node validates that the user should be served from this node. It does this by comparing the user’s IP address to the list of IP blocks advertised to the node via BGP. If the address is not valid for the requested content, the user is redirected to a cache on the Google network.

7. If the content is not already on the GGC node, the node requests the content from Google and caches it.

8. Once the GGC node has the content, it serves it to the user. The content is retained on the node so that the next request can be served without pulling the content from Google.

Maintenance and Support

The GGC system is designed with multiple levels of redundancy. Content and user requests are spread across all available servers, so if a server failure occurs, another server in the GGC node can immediately respond to the user request. If a server is unable to respond to a request, it will redirect the user back to Google.

Google monitoring will detect failures and attempt to resolve issues remotely. In the event that the failure cannot be repaired remotely, we will contact your technical contact to schedule the next step. This next step could include hardware diagnosis, hardware replacement, or software reinstallation. If a hardware swap is required, Google will arrange for the RMA.

Frequently Asked Questions

Q: What is the expected hit rate of the video cache

A: Cache hit rate will vary based on the traffic and usage pattern of your users. Typical cache hit rate is between 70% and 90%.

Q: Will the users be required to make any changes to take advantage of GGC? Could this generate additional call volume on our technical support lines?

A: The system will be transparent to users. If the GGC node is unavailable for any reason, user requests will be sent directly to Google as they are today.

Q: How will Google send content to the GGC Node?

A: The local cache is filled in a read-through basis when content is requested by the end-user. No content is pre-loaded.

Q: What Google services will be supported by the GGC node?

A: Typically, most of the traffic served from the GGC node is large content such as video streams and file downloads. Other web services, such as Google search and maps are proxied and cached as well. Web services are dynamically added and removed from cache nodes based on capacity and end-user performance improvement.

Q: Who owns the GGC node?

A: Google will retain ownership of the hardware and software that makes up the node. Google will be responsible for all maintenance, support, and shipping costs related to the server equipment.

Q: Will other ISPs’ customers be sent to the GGC node on our network?

A: Requests from any user who can access your DNS resolvers may be sent to the node. The node will redirect requests from users outside of the prefixes you are advertising. For this reason, access control lists limiting IP ranges that can reach the cache are not permitted.

If you provide service to downstream ASNs, please ensure their prefixes and resolvers are provided via the BGP feed.

Q: We provide transit services for other ISPs. Will their end users use the GGC node?

A: They can, and probably should, if your network is their primary path to Google. Ensure their user and DNS resolver IP ranges are included in the BGP feed.
 
It's worth noting that they monitor what exactly you're downloading. If it's illegal content they'll throttle (if you take the piss), if not they'll leave you be unless they need to slow you down to accommodate near by customers on the same box (cant remember what the technical name is).

This isn't technically true, it depends on how old your line is a lot of the time, if it was installed in the last few years, then I believe your traffic can be itemized, if it's one from the NTL/Diamond Cable days (like my old one was) it isn't and they can only do it based on pure amount downloaded.

Also they used to have it so only the top 1% and 3% were traffic managed (believe me i know) but the 'OI stop downloading illegal stuff' letters only used to go to the newer customers with the trackable lines but it's been a while since I've heard of one being sent.

The biggest issue with Virgin these days is they prioritise the TV signal over the net one so your connection quality/speed will suffer during Peak TV hours which is a pain in the ass.

When they did that recent "everyone can have 120mb" upgrade, their main infrastructure wasn't ready for it and the stability of said connection was a complete pile of crap, the latency on the lines was unusable for some (again i know this it completely broke bf3 for me for about 4 months). They don't seem to understand the difference between bandwidth, and ping either. The speed was never, ever an issue the ping was just horrific though.

Anyway I'm done ranting, we need a new cable provider in the uk that isn't BT or Virgin, we're so over-charged for the piece of crap service we get here, the speed is just terrible for what we pay compared to other countries. We have the population density to account for the cost of upgrading the thing properly and dropping the prices, they're just too bloody greedy.

Okay I really am done now :P
 
Back
Top