ISP filtering trial company confident it will silence the critics
- 23 September, 2009 16:01
- Comments 32
Enex Testlabs is confident the findings of its report on the Federal Government’s controversial ISP filtering scheme will silence the trial’s critics.
Principal at Enex Testlab, Matt Tett, said he wished more ISPs were a part of the trial, but only because it would have silenced critics.
“The ISPs that were the most vocal against it should’ve been the ones that engaged it the most from our perspective,” he said. “It was good, at the end of the day we’re happy with what we’ve done.
“If there was a failure in the testing or if there were not enough participants or something like that, then we’d say ‘okay we can have a confidence factor of zero’, which means we’re not happy with the tests. If there were issues or wide-ranging issues, then we’d go back to re-test.”
Having more users or ISPs would not have made a difference to the veracity of the trials because they were non-heuristic and blocked a set list of restricted URLs, Tett said.
“Given the technology we tested, it wouldn’t have made any difference. The technologies that were participating in the trials from a filtering perspective wouldn’t have made any difference really,” he claimed.
“The [Department of Broadband, Communications and the Digital Economy] has been very flexible, and wanted to make sure it was as accurate as possible. We’ve gone back to them on a number of occasions with different suggestions and they’ve come to us as well with suggestions they’ve received and queried us on it and it’s been evaluated and even incorporated and put into the test.”
Tett’s comments come after statistics experts labelled the use of an opt-in method of selecting sample users as unscientific.
The Enex principal compared public comments about the testing methodology to those made when the Australian Communications and Media Authority (ACMA) trials were being completed and remained confident the Australian public would respect the trial results when they were released by the Government.
“It’ll be funny once it’s over, it’s just like the ACMA thing, just a storm in a teacup - maybe not the politics or the ethics but the actual testing,” he said.
Come socialise with us! Facebook | LinkedIn
- Bookmark this page
- Share this article
- Got more on this story? Email ARN
- Follow ARN on twitter
- Market Potential-Strategy Guide to the Active Archive Market
- Spectra Logic and Australian National University Success Story - March 2012
- In Search of the Long-Term Archiving Solution —Tape Continues to Be a Major Player
- Premier Media Group Fast Study
- Aberdeen Group: Building Business Resilience Through Active Archive
-
Telstra announces HTC One XL
-
Tech Watch: Who watches the datacentre?
-
Preview: HTC One S
-
Facebook scammers host Trojan horse extensions on the Chrome Web Store
-
Webroot: Growth in security














Comments
Ben
You're kidding!
Enix considers a trial ISP consisting of 15 customers, and ISPs which had around 1% of the customer base opt-in as evidence of a policy which will be mandated to all ISPs, including Bigpond which has millions of customers who will all be filtered?
Where's the high traffic URLs which were conveniently omitted from the trial? Were the omitted because "Given the technology we tested, it wouldn’t have made any difference."? Surely not...
CW
Siliencing the critics?
<cite>Enex Testlabs is confident the findings of its report on the Federal Government’s controversial ISP filtering scheme will silence the trial’s critics.</cite>
That is exactly what I am afraid of, a mandatory Internet filter could be used to silence critics very effectively.
Eddie
Enex must be stupid if they think the trial results will silence critics.
The trial was poorly conducted thanks to shoddy government-mandated methodology and a lack of serious amount of participants. Enex knows this but won't admit it in order to hang on to the $800,000 bribe, er, payment they were given for the trial.
All in all, Enex's credibility has gone right down the toilet.
I hope Enex are proud of themselves for helping the government in their attempts to censor the entire country.
Anonymous
enex
To respect the trial results one has to respect the criteria, the trial participants, the assessors, the data and the rigorous validity of the testing methodology. This participant attempts to disparage the opposition to his amazingly primitive manipulations by treating the exercise as some kind of merry jape. Sorry son, snake oil bought by government blood money won't cut the mustard. Enjoy your coming notoriety, you deserve it.
Tardis42
they claimed WHAT?
Watchdog international, the filtering vendor used in MOST of the trial ISP's, just released a whitepaper based on their experience in the trial. It explicitly states that their filter CANNOT handle several types of URL on the list, and that they had to exclude from the list pages on high-traffic sites such as Youtube. They claim that this is ok because Youtube has takedown policies, but fail to realise that the content on youtube that is on the filter list (the peacefull pill handbook video edition) IS rated RC in Australia and so would have to be blocked, but is perfectly legal in the US and every other western country, so wouldn't be removed. Watchdog, therefore, cannot be used for the filter, and other filtering vendors will have the same problem.
The watchdog Whitepaper is available from their website <a href="http://www.watchdoginternational.net/images/listwhitepaper_3.pdf">Here</a> (pdf)
Anonymous
Results
Excuse me Matt. Conroy has already said that ACMA will not be releasing your results.
They'll be releasing their own results. I hope you'll be happy to be associated with them.
MR1979
No silcence from me.
As long as this stupid crappy tax payers waste of money of a filter nee censorship is going I am not going to be silent about it.
klaw81
Enex is living on another planet
Enex is kidding themselves if they think the critics will even consider their findings to be valid.
What we already know about their testing methods allows us to conclude that the testing results will be meaningless and a total waste of taxpayer's money.
Of course, the Government doesn't listen to critics anyway...they only want yes-men to tell them what they want to hear. Never mind that many of the critics are highly-qualified experts in their field.
Unconvinced
Not convinced
“It’ll be funny once it’s over, it’s just like the ACMA thing, just a storm in a teacup - maybe not the politics or the ethics but the actual testing,” he said.
I'll reserve final judgement until the report is in the public domain. Not the report DBCDE generates, but the Enex report. There's no chance of critics shutting up on the politics and ethics of this.
When a filter specifically built for blocking known urls needs to whitelist high volume sites that have blacklisted URLs that's hardly fit for purpose.
After the embarrassment of the actual contents of the ACMA secret list becoming public apparently X18+, R18+ etc is being dropped. Scaling back to RC is still an issue. That's a phenomenal amount of content. Far more than 1300 or 10,000 URLs on a list is going to be needed (add lots more zeroes)
There is likely to be hundreds of clips in Youtube alone that fall foul of our RC (including RC film 70k.. already classified by our CB). So we can dispense with even RC being the worst of the worst content. Youtube aren't going to be taking those clips down and Youtube isn't exactly a den of depravity.
RC is very broad. It's not just child sexual assault material.
Anonymous
White Man Speak for Fork Tounge
“The ISPs that were the most vocal against it should’ve been the ones that engaged it the most from our perspective,” he said.
What about those ISP's who asked to be on the trial and where rejected?
“If there was a failure in the testing or if there were not enough participants or something like that, then we’d say ‘okay we can have a confidence factor of zero’, which means we’re not happy with the tests. If there were issues or wide-ranging issues, then we’d go back to re-test.”
Yes and those ISP's who were likely to say that were excluded from the trial, or at least admitted after significant protest! http://www.news.com.au/technology/story/0,28348,25040817-5014239,00.html
Akira Doe
Nearly all networking technology be it modems or routers etc perform differently when they have a load of 15 users compared to 100,000's, especially equipment that has to inspect packets to find their destination and then let them pass or block entirely. I can't believe that they've said "Given the technology we tested, it wouldn’t have made any difference."!
The only reason I can think of is the filters using some sort of DNS poisoning, which potentially makes it even easier to bypass than before.
I'd love to see the Enex report, not the DBCDE's report on Enex's findings simply because I would love to know how they tested, and WHAT they tested. And testing users on ISP who already offer filtering that they’ve CHOSEN to sign up for isn’t going to give you enough of a “hostile” user base to test how easily or how many users are able to bypass the filters.
The most important information we need is how many users took place. Internet technology doesn't work like TV ratings. An almost insignificant user base cannot be up scaled to represent the entire user base.
Since most ISPs allowed users to opt-OUT of the trial, or specifically had to opt-IN to the trial there is no way there was 100% uptake, so even with iPrimus and Optus being among the participants the actual user base could still have been miserably small, especially compared to the total number of users who will be forced down this path once the filters are made mandatory.
Senator Conroy, it’s now time for some of that Transparency and “Evidence” based approach you’ve been talking about. If we don’t get to see the Enex report, the one that is apparently peer reviewed, yet unreleased to peers, and you use it as “Evidence”, opponents of the filter then have all the “Evidence” needed to prove you’re lying to the country to pass this misguided policy (actually, thanks to the Senate Question Time, we already know you are)!
Enex, If you conducted your trial properly then I almost feel sorry for the position you are in, but if everything is as it appears you've brought this mess on yourselves and deserve all that's coming you way.
Daniel Raffaele
What a waste.
If I had known about this policy before the election, I wouldn't have voted Labor. If this atrocity goes ahead, I won't be voting Labor ever again.
This is an absolute disgrace and if we lived in a country that had the guts to install a BILL OF RIGHTS we wouldn't have to put up with a government that clearly doesn't respect its constituents.
This is just the first step in the Australian government's war on the internet. Rather that doing what they promised - bringing Australian broadband up to international standard - they instead are planning on slowing it down to a level where it will quicker to send a message by courier pigeon than by email.
Censorship, mandatory filtering, interception - where will it end? Kevin Rudd and his minion Stephen Conroy are the worst kind of internet criminals.
Matt
That's one magical piece of hardware
<cite>“Given the technology we tested, it wouldn’t have made any difference. The technologies that were participating in the trials from a filtering perspective wouldn’t have made any difference really,” he claimed. </cite>
I want a one of these filtering boxes that can scale infinitely! Who does he think he's kidding of course load would have made an effect!
Anonymous
Enex Testlabs
"Enex Testlabs is confident the findings of its report on the Federal Government’s controversial ISP filtering scheme will silence the trial’s critics."
Smells like Enex Testlabs are sniffing the **** of Senator Conroy with a bit of $$$ under the table to make sure Conjob gets his way!!! All I can say is (on behalf of all the voters out there) - STICK IT UP YOUR **** LABOR, WE WILL NOT VOTE FOR THE RIGHTS TO BECOME A 2ND CHINA!!!
Greg
How can filtering one client be the same as filtering thousands of clients? That's some pretty damn efficient filtering software and hardware, why didn't anyone tell me you could buy sticks of infinite RAM?
Jason
What a joke
How can you possibly trial and get good data with such a small amount of participants, you simply cannot. You can't know what will happen when the filter goes live with BigPond and it's millions of customers hit it at peak time.
Why don't we trial that if we want accurate data?
Technical issues aside, it is not wanted by the Australian public (less than 4% of those surveyed wanted the Government to control the internet) and should NOT happen.
Matthew
What I get from this article is that Tett is saying they tested accuracy more than performance. From the tone, it seems they are wanting to silence those folks that are complaining about over/under blocking. I agree that it's easy to be 100% accurate with a static list of addresses. What he is conveniently avoiding is that it's hard to scale that up to tens or hundreds of thousands of users. And that's something he wasn't able to test. In any case, it's pointless for Tett to make these assertions as his report won't be available for peer review by the very critics he hopes will be silenced by it.
Anonymous
is that headline ment to be ironic?
Sure they will silence us by removing out access to the internet and putting us in jail for free speech..
whos up for being silenced by national censorship?
glenn
charliem
Even if its a success in terms of accuracy and performance, it still will not silence its critics.
The main criticism is not of how effective or accurate it is, but the very act of censoring the internet in the first place. It is a disgrace of an idea, putting us alongside other high-functioning human-rights violators such as Iran, Saudi-Arabia, China etc.
Roddy
Scalability & accuracy?
Associates of our's just finished a proof of concept with the exact same requirement of IP based rerouting to the URL blacklist filtering box in a carrier environment, however live with approx. 6,500,000 users. Not with Netclean, Watchdog, Enex or 8E6...
No noticeable latency, hardly measureable delays and way within strict SLA values. 100% accurate with a large URL blacklist.
From that angle and using telco grade systems, Matt Tett is correct. The system model is scalable, very scalable.
The URL filtering system here had the right software running, built for telco/carrier networks, and was on a quality mid-range server.
I have worked with Tett and Enex in the past, not now though, and am amazed that he is being vilified on the basis of fulfilling a contract that Enex have had with the Gov for a number of years. None of the people slagging off at them now were around and had anything of value to say when Enex did previous tests, NetAlert tests etc.
Sounds and looks like lynch mob mentality. Slagging off at them purely due to them facilitating the tests and not openly and publicly breaking their contract clauses / conditions. Ante up with some *proof*, not myriad heresay, that they are doing anything illegal or unethical, or hold your peace until you have some...
That would be illegal or unethical by legal standards, not opinionated standards and personal views.
Some of you guys have seriously lost the plot.
Anonymous
Roddy = Netsweeper.
Roddy would appear to be our favourite "Security Techo" from Netsweeper, obliquely referring to their deal with BSNL in India.
Keep on astroturfin'...
V for Vendetta
They ask too much
Enix ask us to be silent about a trial:
- which they will not, or cannot, publish,
- which used criteria they will not, or cannot publish; and
- a methodology they will not, or cannot publish...
...about the functionality of a black list:
- which will not be published (officially); and
- is maintained by people who cannot be identified; and
- will not be reviewed except by non-identified parties
That is a long sentence, a long list of things to trust and a long bow to pull Enix. Yoyu want us to be silent? Unlikely. Perhaps silence is what you might be best served by offering yourselves now?
Steven
Enex's credibility falling by the day
If they genuinely believe that having more ISPs and more test participants wouldn't have provided more accurate results from the "trials" then they have seriously deluded themselves and demonstrated a lack of understanding of technology. They also seem to have forgotten that one of the ISPs that they referred to as being one of the biggest critics that they wanted involved, iiNet, was excluded from testing by DBCDE because iiNet wanted the tests to be realistic!
Colin Jacobs
Are they kidding?
The test cannot silence critics, because the test was commissioned even before the policy was defined - in fact, it's still not defined. Unless the test shows the whole thing is to be called off, concerns remain as much as ever.
- What is the point of this scheme?
- What will be blocked? Will the list be secret?
- How will errors be redressed?
- How will creep of the list be prevented?
- What benefit does the public get for the high cost?
- Can't the resources better be spent on education or policing?
Anyway, I'm sure technical issues will remain. What happens when a single wikipedia page is blocked, does the entire country end up going via one proxy?
Anonymous
pfft
The wowser government is destroying Australia
Anonymous
regardless of ethics
" ..just a storm in a teacup - maybe not the politics or the ethics but the actual testing,” he said.
Ethics has no place in research?
To the camp commander the only question was efficiency - getting them off the railway and into the ovens.
It never has been a question of COULD, it has always been SHOULD. Enex quite clearly demonstrates which uniform they would wear.
Roddy
BSNL? Nah...
Nice try, but not BSNL...
Bigger.
harry
Successfull or not.
The real problem is, nobody wants it, internet filtering that is. Except that religious nut Conroy and Enex.
Anonymous
This will NOT silence the crtitics at all -
The only way the will silence the critics is by abandoning this scheme all together ... given that it can be by passed via VPN or other methods it's a waste of money. The report (apparently released tomorrow) is going to be a total whitewash given that it's been written by the ministers department and not by a independant no bais party!! Another reason why the critics will not be silenced!
You'd silence more critics if the government took the word "mandatory" out of the equlation.
Enex have not creditablity in saying anything in relation to this trail as we know it's a facade.
Rufus Boy
Change the Government, Change the Nation
People maybe should have though a little longer when they were standing in the ballot box in 2007.
The Howard government was full of morons and liars, but what political party isn't?
Are things better now, or worse?
People need to realise, when you change the government, all manner of things that you had never thought about get changed as well. Was this an issue in 2007? Had anyone even noticed? Yet here we are with out government joining the ranks of China, North Korea, and Iran, in controlling what we can and can't access on the internet, and worse still not telling anyone what they will be blocking.
If you really want this problem to go away......
Change the Government, change the Nation.
Anonymous
Yes, our government is exactly like Iran's. Australians have national dress codes and morality police patroling the streets.
Please, people, a little perspective. Hysteria from the anti-filtering brigade does no one any favours - in fact, it just makes your entire argument look really silly.
Anonymous
enex crooks
“It was good, at the end of the day we’re happy with what we’ve done.
for $800k of taxpayers money and questionable testing i am sure you crooks at enex are happy
Post new comment