When Tony Richards, the Head of Payments Policy at the Reserve Bank of Australia (RBA), read the recent survey results from Finder’s Crypto Report
When Tony Richards, the Head of Payments Policy at the Reserve Bank of Australia (RBA), read the recent survey results from Finder’s Crypto Report saying that almost one in five Australians owned crypto, he didn’t believe it for a second.
However, the results had already been widely published around the country, gracing headlines for weeks. They even made their way into the recent Senate Committee on Australia as a Technology and Financial Center’s final report in October.
Welcome to the statistically dubious world of cryptocurrency surveys — an easy way for companies to get publicity by hawking survey results, but not necessarily a great way to stay informed.
The Finder survey from August claimed that 17% of Australians own at least one cryptocurrency — 9% own Bitcoin, 8% own Ether and 5% own Dogecoin.
Is the figure plausible?
Richards called these figures into question in his address to the Australia Corporate Treasury Association on Nov. 18, saying that he finds them “somewhat implausible.”
“I cannot help thinking that the online surveys they are based on might be unrepresentative of the population,” he said.
The Reserve Bank of Australia’s head of payments policy Tony Richards said that the growth of crypto in 2021 was “no doubt fuelled by influencers and celebrity tweets.”
— CoinzProfit (@CoinzProfit) November 19, 2021
He referenced “important segments of the population” including the elderly, people living in regional areas, and those without reliable access to the internet, that online survey panels “do not capture well.”
His point echoes a similar sentiment outlined by Dr. Chittaranjan Andrade in his 2020 report for the Indian Journal of Psychological Medicine, where he claims online survey samples are often unrepresentative, regardless of the subject.
Online surveys are completed only by people who are “sufficiently biased to be interested in the subject; why else would they take the time and trouble to respond?” he wrote.
But the Head of Consumer Research at Finder, Graham Cooke defended the methodology, telling Cointelegraph:
“The respondents are selected based on age, gender and location to create a sample which fairly reflects the results that would be expected from a full national survey.”
“We are confident that this produces a trustworthy sample which is representative of the population,” he added.
In the 15-page report summarizing survey results, there are only a few lines at the end to explain methodology. It says: “Finder’s Consumer Sentiment Tracker is an ongoing nationally representative survey of 1,000 Australians each month, with more than 27,400 respondents between May 2019 and July 2021.”
The survey is conducted by Qualtrics, a Systems Applications and Products in Data Processing (SAP) company. Qualtrics’ website boasts, “in just ten weeks Finder lifted brand awareness 23 percent,” but there was no additional information regarding survey methodology, and did not provide any on request from Cointelegraph.
A Finder spokesperson was able to confirm to Cointelegraph that: “Qualtrics collects respondents from various panels and can be incentivized in different ways. Some are paid a small fee for their participation, some earn a charity donation, for example.”
Different surveys have estimates 2M people apart
This is not to single out Finder’s survey for particular criticism: There appears to be a new survey every day and often their findings are at odds with one another.
Take the YouGov survey commissioned by Australian crypto exchange Swyftx, which found that the number of Australians who hold crypto is closer to 25%. The July survey collected responses from 2,768 adult Australians, and the figures were weighted using estimates from the Australian Bureau of Statistics. This survey was found to be compliant with the Australian Polling Council Code.
However, both surveys can’t be correct. The population of Australia is 25.69 million. This means that Finder’s 17% of the Australian population equates to roughly 4.37 million people. Meanwhile, Swyftx’s 25% is about 6.42 million people.
The difference between the two estimates translates to just over two million people — that’s more than the entire population of South Australia.
The numbers also don’t appear to be reflected on local platforms. Crypto trading platform Binance Australia told Cointelegraph that it had 700,000 users, Easy Crypto Australia said it had around 15,000 users, Swyftx has 470,000 users (many from overseas). BTC Markets has over 330 000 Australian users and Independent Reserve’s site claims 200,000 users.
Digital Surge, eToro, Coinspot, and Coinmama did not respond with user numbers.
Not all Australians use a local exchange to trade their crypto of course, but on the other hand, a significant proportion of users are signed up to multiple local exchanges. There appears to be a mismatch of hundreds of…
cointelegraph.com