Twitter “completely unresponsive” on clickable domains

Elon Musk’s Twitter is “completely unresponsive” to outreach about Universal Acceptance of domain names, including problems such as the lack of linkification of new gTLD domains, according to an ICANN technologist.

Speaking at an ICANN 79 Prep Week session yesterday, senior UA technology manager Arnt Gulbrandsen said the Org has been attempting to work with major platforms such as Google’s Gmail and WordPress to encourage support for newer, longer gTLDs and internationalized domain names, but with mixed results.

“What we are doing is identifying the most important, the biggest actors… testing, reaching out or contributing changes,” he said. “We don’t work equally with all. If someone’s unresponsive, then we more or less stop talking to them and hope that they grow less important as time passes.”

“This means Twitter,” he said. “Twitter is completely unresponsive.”

Twitter and other platforms such as WhatsApp have been criticized recently by the people behind gTLDs including .music and .tube for failing to “linkify” their domains. When you tweet a .music domain without the http:// prefix it will not automatically become clickable, for example.

Twitter’s cut-off point for recognizing TLDs appears to be mid-2020. The three gTLDs delegated after that — .spa, .music and .kids — do not currently linkify.

Gulbrandsen said ICANN has been getting a more encouraging response from developers within the WordPress ecosystem, where ICANN discovered that UA support relies a great deal on just three software components maintained by volunteer developers — linkify-it, phpautolink and phpmailer.

“I’m really happy about the responses from some of these obscure, open-source maintainers,” he said. “They really want to do the best for the world, and they are volunteers mostly.”

Two of the identified components currently support UA and ICANN is working with phpmailer, he said. ICANN has also been contributing UA code even further down the stack, to programming languages such as Java, Python and Ruby, he said.

Gulbrandsen’s presentation came during the ICANN 79 Prep Week session on UA, which included contributions from members of various UA working groups and focused largely on IDN and email problems. You can listen to the session in full here.

ICANN insists it is working on linkification

Having been accused of ignoring the lack of universal support for new gTLDs in favor of virtue-signalling its support for multilingual domain names, ICANN has now insisted it is working on the problem.

ICANN chair Tripti Sinha said in a letter (pdf) published today that ICANN staff have been “actively engaging” with the software developer community on a “multitude of efforts” aimed at getting Universal Acceptance for all domain names.

She was responding to an October 2023 letter from .tube CEO Rami Schwartz, whose solo research last year uncovered the fact that many major app developers — including WhatsApp maker Meta — were relying on hard-coded TLD lists up to eight years old to validate domains.

This meant domains in the hundreds of TLDs that went live after November 2015 were not being detected as domains, and therefore not automatically “linkified” into clickable links, in many near-ubiquitous apps and web sites.

But Sinha insists that ICANN has been putting resources into the problem, including creating a “technical UA team” that is “actively engaging with technical organizations and communities, raising bug reports, as well as contributing open-source code where possible”.

The team has been participating in hackathons and conferences to push the UA message, she said, and has engaging in web sites such as Stack Overflow (where coders ask each other questions about tricky programming problems) to educate developers.

She named Meta and WordPress as software companies ICANN has been reaching out to directly.

“The ICANN org team has been meeting with META and reported UA related issues to them, including linkification. The team has recently also reported the issues shared by you related to more recently delegated TLDs, including .TUBE,” she told Schwartz. “META continues to look into these issues and is making progress towards resolving them.”

She also pointed out that ICANN and the ICANN-funded Universal Acceptance Steering Group held a Universal Acceptance Day last year and will conduct another this year.

UA Day is actually dozens of individual events — over 50 last year — that took place across the world over the space of a couple of months. This year’s event appears to be equally diverse, with events taking place from March to May across many locations mainly in Asia, Africa and South America.

The UASG supplies PowerPoint presentations and videos to each event to use if they wish, but the focus is very much on the substantially trickier problem of UA for internationalized domain names — domains or email addresses that use non-Latin scripts or diacritics not present in ASCII — rather than the lower-hanging fruit of getting developers to update their TLD lists more frequently.

Even though there hasn’t been a new TLD delegation for a couple of years, there were still almost 30 TLDs deleted from the DNS root last year. The number of valid TLDs changes perhaps more frequently than many developers realize.

Walking down the street somewhere, I once saw a barbershop called “Every Six Weekly”. Crap brand, certainly, but the message lodged itself in my borderline autistic nerd brain — that’s how often society expects me to get my hair cut, every six weeks.

Maybe ICANN should try something like that.

.ru domains fly off the shelf as Western sanctions bite

Russia’s ccTLD has posted very impressive growth in registrations for 2023, attributable largely to sanctions related to the country’s invasion of Ukraine.

ccTLD.ru, the registry for .ru and .рф, reported that it ended 2023 with 5,439,137 .ru domains, an increase of 506,024 or 10.3% over the year. It said 85% of the names were registered by Russians.

It said 1,709,718 new domains were registered in .ru, with over 200,000 being registered per month by December.

For comparison with fellow top-10 ccTLDs, Germany’s .de grew by 201,000 names last year, and Brazil’s .br grew by 220,000. The UK’s .uk shrank and the Netherlands’ .nl was basically flat.

In the smaller Cyrllic .рф, the growth rate was even greater — 13.7%, with 768,883 domains in total at the end of the year, up 92,769 names, the registry said.

Despite the rapid growth, .ru is still a bit off its 2017 peak of around 5.53 million domains, according to my database.

In a press release, ccTLD.ru director Andrey Vorobyev admitted that one of the “main drivers” of the growth were Russians transferring their sites to Russia “under the pressure of sanctions”.

After Russia launched its full-scale invasion of Ukraine in 2022, many domain registries and registrars in the West unilaterally decided to stop doing business with Russian citizens and organizations, despite US government sanctions specifically not applying to domains.

GoDaddy cut off Russians and .ru while Namecheap, which has many support staff in Ukraine, cut off Russian customers and continues to prominently fund-raise for Ukraine on its storefront. Other companies announcing boycotts included 101domain, IONOS and Nominet.

Ukraine’s ccTLD, .ua, has fared less well during the crisis. Its total domain count shrank by about 77,000 to 514,000 in 2023, according to my database. The local registry, Hostmaster, had frozen deletions for a period to give people who had been displaced or mobilized more time to renew, but started releasing those domains last year.

Hostmaster has reported adoption of certain third-level geographic .ua domains that use Latin transliterations of Ukrainian place names, rather than Russian — .kyiv.ua versus .kiev.ua for example — as citizens seek to “de-Russify” their holdings.

After 14 years, ICANN practices what it preaches on IDNs

Almost 14 years after the first non-Latin domain names were added to the DNS root, ICANN has finally declared itself IDN-compatible.

“ICANN staff can now send emails to and receive emails from internationalized email addresses,” the Org said in a blog post today.

“ICANN also supports short and long ASCII top-level domains in all systems, as well as ASCII-based Internationalized Domain Names (IDNs) in Punycode (A-label) in public-facing systems,” Org added. “In addition, IDNs in Unicode (U-label) work in ICANN’s public-facing systems.”

It’s the weakest brag imaginable.

ICANN is the organization that is tasked with ensuring the internet’s naming and addressing systems are interoperable globally. It’s the one organization on the planet that absolutely, by definition, has to deal with the owners of IDNs.

And yet it’s taken almost 14 years for this milestone to be reached. The first IDN TLDs — the Arabic translations of the ccTLDs of Egypt, Saudi Arabia and the United Arab Emirates — were delegated to the DNS root May 5, 2010.

As my post from that time reflects, IDN support then, even in browsers, was awful.

There have been 159 IDN TLDs in the root since the first batch (about half a dozen or so were dot-brands that have since been retired) and a great many Latin-script TLDs support IDNs at the second level.

To be fair, ICANN cannot shoulder all the blame for this tardiness. Presumably, Org uses the same off-the-shelf email systems as the rest of us, so it would have been reliant on its vendors to add the necessary support.

Today’s blog post notes that ICANN had to work with its technology partners to impress upon them the importance of IDN support and Universal Acceptance in general.

ICANN has made greater IDN adoption one of its main goals of the forthcoming next application round of the new gTLD program, part of an effort to get more registries founded in currently under-served regions.

But there are some who believe this focus on IDNs has come at the cost of ignoring Universal Acceptance issues affecting Latin-script TLDs.

Popular social networking apps — surely the most common vector for link-sharing nowadays — have been found lacking in their support for the most recently created TLDs, and some say ICANN has failed its duty to reach out to developers to school them on UA.

Last year, the CEO of .tube discovered that popular software was relying on a hard-coded list of TLDs in the Android operating system that had not been updated since November 2015, meaning the 468 TLDs that have been delegated since then would not be recognized as domains and not “linkified” when shared on apps such as WhatsApp.

It also seems that Twitter as of this week is still relying on a hard-coded TLD list that has not been updated since 2020, meaning domains in the three TLDs that have been delegated since then — .spa, .kids and .music — are not linkified.

Given how simple updating a TLD list should be, and given that somebody at ICANN presumably has the ear of somebody at Twitter or Meta or Google or wherever — Android updated its list pretty quickly when alerted to to the problem by .tube — it’s baffling to me that these problems persist in the light of ICANN’s stated focus on UA.

The first four new gTLDs have been unmitigated disasters

“Arabic ‘Dot Shabaka’ goes online, ‘Dot Com’ era nearing end”.

That was a headline from a Turkish news site in February 2014 when the first Arabic gTLD — شبكة. — went to general availability, having been delegated to the DNS root October 23, 2013, 10 years ago next week.

It was one of the first four gTLDs to go live from ICANN’s 2012 new gTLD application round. At the time, the registry very kindly documented its launch on the pages of this very blog.

A decade on, شبكة. — which transliterates as “dot shabaka” — has just 670 registered domains, a 2015 peak of 2,093 names, and barely any active web sites of note. The registrar arm of the registry that runs it, GoDaddy, doesn’t even support it.

شبكة. is the Arabic for “.web”. The dot goes to the right because Arabic is read right-to-left. A full domain looks like this فيمأمنمنالألغام.شبك in your address bar but in the DNS, the TLD is represented by the Punycode .xn--ngbc5azd.

Given the Latin-script version of .web auctioned off for $135 million, and that there are 274 million Arabic speakers in the world, you might expect there to be a thirsty market for dot shabaka domains.

Nope.

It added about 2,000 domains in its first three months, crept up to 2,093 over the next two years, and has been on the decline pretty much consistently ever since. It has 40 accredited registrars, but only 21 of those have any domains under management.

Notably, GoDaddy has zero dot shabaka names under management, despite GoDaddy Registry being the official registry due to a string of consolidation ending with its acquisition of Neustar’s registry business over three years ago.

Its largest registrar is Dynadot, which seems to have a pretty responsive, intuitive storefront for non-Latin domain names.

Doing a site search on Google reveals the registry’s NIC site as the top hit — never a good sign — and a first page dominated by broken, misconfigured, and junk sites. An anti-landmine organization and a reputation management service are among the legit sites that show up.

One of the first-page results is actually in Japanese, a page declaring “ドメイン「المهوس.شبكة」は、日本語では、「オタク.ネット」という意味です。” or “The domain ‘المهوس.شبكة’ means ‘otaku.net’ in Japanese.” (per Google Translate).

It’s hardly a ringing endorsement of the demand for Arabic script names. If a reasonably priced, .com-competitive, god-tier gTLD such as “.web” is a backwater neglected even by its own registry, what does that say about any long-tail internationalized domain name gTLDs that might be applied for in the next ICANN application round?

We don’t have to wait until then to get a sense, however. Dot shabaka was one of four gTLDs delegated on the same October 2013 day, and the others haven’t fared much better. The other three were:

• .xn--unup4y (.游戏) — means “.games” in Chinese. Operated by Identity Digital (formerly Donuts).
• .xn--80aswg (.сайт) — means “.site” in several Cyrillic languages, including Russian. Operated by CORE Association.
• .xn--80asehdb (.онлайн) — means “.online” in several Cyrillic languages, including Russian. Also operated by CORE Association.

You might expect .游戏 to do quite well. There are over a billion Chinese speakers in the world and gaming is a popular pastime in the country, but this TLD is doing even worse than dot shabaka.

While it was a day-one delegation, Identity Digital didn’t actually start selling .游戏 domains until early 2017, so it’s had a shorter amount of time to build up to the pitiful 318 domains recorded in the last registry transaction report. While its DUM number is lumpy over time, there’s an overall upward trend.

Compare to Latin-script .games (also Identity Digital) which had over 48,000 domains at the last count. Even comparing to premium-priced and XYZ-operated .game (Chinese isn’t big on plurals), which had 4,227 names, is unfavorable.

The two decade-old Cyrillic gTLDs aren’t doing much better, despite there being 255 million Russian-speakers in the world.

While .онлайн (“.online”) has a relatively decent 2,340 domains, the English version, run by Radix, has 2,732,653 domains. The Russian “.site” (.сайт) has just 829 domains, compared to Radix’s English version, which has 1,501,721.

The major Russia-based registrars, while they are understandably the biggest sellers of Cyrillic gTLD domains, are actually selling far more of their Latin-script, English-language equivalents.

Reg.ru, for example, has 99,716 .site domains under management, but just 249 in .сайт. It has 188,125 .online domains — where it is the fourth-largest registrar — but just 918 in .онлайн.

While there are certainly supply-side problems, such as the problem of Universal Acceptance, I suspect the abject failures of these four IDN gTLDs to gain traction over the last decade, despite their first-mover advantages, is based at least equally on a lack of demand.

ICANN has made UA — particularly with regards IDNs — one of its top priorities for the next new gTLD application round. Supporting a multilingual internet is one of the CEO’s goals for the current fiscal year.

But it had the same goals in the 2012 round too. The reason the first four to be delegated were IDNs was because IDN applicants, in act of what we’d probably call “virtue signalling” nowadays, were given priority in the lottery that decided the order in which they were processed.

Second time lucky?

Ukrainian domains slide as war becomes the new normal

Ukraine’s ccTLD is starting to see a decline in its total domains under management as emergency policies related to Russia’s full-scale invasion in February 2022 are relaxed.

According to local registry Hostmaster, .ua’s total was down 1.5% at the end of the first quarter at 612,778 domains, due to the fact that expiring domains that were frozen in 2022 have now started to drop.

Hostmaster said the effect will become more noticeable in coming quarters. Stats show a decline of about a thousand domains since the end of June.

When the war started, .ua had about 558,000 domains. It peaked at around 614,000 in early June.

Early in the conflict, Hostmaster had said that expired domains would be held in a redemption period status. Many registrants were assumed to have been drafted into the military or refugees.

Since then, the registry says a “significant number” of expired domains have been restored.

However, the policy was rolled back this June; expired domains now have the antebellum standard 30 days to be restored. Domains that were not renewed in 2022 still have a November deletion date, Hostmaster said.

Meanwhile, WIPO has recently restarted its UDRP services for Ukraine, having paused them in May 2022 in response to the war. Decisions that were paused in early 2022 have now been executed and published.

Registry launches Ukrainian domains for Russian-occupied region

A Ukrainian registry has started offering domains in a second-level Ukrainian transliteration of a Russia-occupied region.

Southern Ukrainian Network Information Center started offering residents of the Mykolaiv oblast domains at the third-level under mykolaiv.ua at the start of October, according to the registry’s web site.

Mykolaiv is the Ukrainian version of the original Cyrillic name. Previously, domains were only available under the Russian transliteration, .nikolaev.ua. SUNIC also offers the shorter .mk.ua domain.

Mykolaiv, in the battle-scarred south of the country, is also the name of the region’s capital city. While the city has resisted Russian capture, much of the region has been under the invading force’s control since early in the war.

SUNIC, which also offers odessa.ua (Russian) and odesa.ua (Ukrainian) names for the Odesa region and city, is encouraging .nikolaev.ua registrants to acquire their matching mykolaiv.ua names.

Adopting Ukrainian transliterations of Cyrillic place names has been seen as a symbolic act of defiance against Russian ambitions.

Ukrainians urged to “de-Russify” their domains

There’s reportedly a push in Ukraine to get registrants of Russian-transliterated TLDs to switch to their matching Ukrainian versions.

Ukraine’s .ua offers domains in dozens of second-level domains, many of which correspond to the names of cities, such as kyiv.ua and .kharkiv.ua.

But while pretty much everyone in the Anglophone world and elsewhere has started using the Ukrainian transliterations as standard in the six months since Russia invaded, Ukrainian domain registrants have been slow to follow.

According to local registry Hostmaster, today there are 38,564 names registered in the Russian .kiev.ua, but only 1,965 in the Ukrainian .kyiv.ua.

Now local hosting company and registrar HOSTiQ is now reportedly offering customers the chance to swap their Russian domains for the Ukrainian equivalents for free.

.ua as a whole has over 580,000 registered names.

Ukraine won’t delete domains until war is over

Hostmaster, the Ukrainian ccTLD registry, has indefinitely paused domain deletions due to the ongoing war with Russian.

The company said its domain redemption period, which usually lasts 30 days after a registration expires, will now run until the end of martial law, which was brought in by the government shortly after the invasion.

The registry had previously, and perhaps optimistically, extended the window to 60 days. But the war continues, and many registrants are still unable to renew their names.

Since the first extension, registrars have already recovered over 300 names that were not renewed in time, Hostmaster said.

The price to restore an expired .ua name is the same as a renewal, the registry said.

War fails to stop .ua domains selling

Ukraine’s ccTLD has maintained what appears to be a healthy level of new registrations, despite the Russian invasion.

The company today reported that between February 24 and March 25, it saw over 3,000 new .ua domain regs, over 2,000 of which were in .com.ua. The ccTLD offers names in a few dozen third-level spaces.

February 24 was the day Russia invaded, and the day Ukraine went into martial law.

“The com.ua domain is mostly used by commercial organizations. Therefore, the presence of registrations shows that Ukrainian business continues to operate under martial law,” Hostmaster wrote (via Google Translate).

.ua had a total of 534,162 domains under all 2LDs today, according to the registry’s web site.

While Hostmaster has not yet published its end-of-month stats for March, it appears that the new adds suggest an improvement on typical monthly performance, or at least business as usual.

The registry has come under denial-of-service attack dozens of times since the war started, but says it has so far continued to operate without interruption.