LOGO

Sorry, this entry is only available in JA.

NVIDIA announced its fiscal year earnings for January 2024 on February 21st. The annual revenue reached $60.9 billion, marking a 126% increase from the previous year, with operating profit soaring to $33 billion, an increase by 7.8 times.

For the fourth quarter (November to January), the revenue was $22.1 billion, a 265% increase year-over-year, exceeding the company’s forecast of $20 billion. The operating profit for the quarter reached $13.6 billion, a tenfold increase, with an operating margin surpassing 61%.

In response to the strong performance, the after-hours stock price surged by over 7%. The sales forecast for the February to April period is set at $24 billion (±2%), with a confident outlook stating, “We will continue to grow in 2024, 2025, and beyond.”

Half of data center sales are for the cloud

Demand for data centers continues to drive NVIDIA’s performance.

Data center revenue has been increasing quarterly, with the third quarter reaching $14.51 billion, a 279% increase. The previous quarter saw revenue of $10.32 billion, a 171% increase, and the first quarter reported $4.28 billion, a 14% increase.

In the latest quarter, more than half of the data center revenue came from major cloud providers.

Jensen Huang, the founder and CEO of NVIDIA, stated, “Accelerated computing and generative AI are at a turning point. There is a surge in demand worldwide across corporations, industries, and nations.” He claims that the data center installation base amounts to approximately $1 trillion and predicts the emergence of data centers worth $2 trillion that will power global software over the next four to five years.

Will NVIDIA Continue Its Dominance?

The demand for data centers is expected to grow further. With the expansion of generative AI, the demand for high-performance semiconductors is surging, and NVIDIA is extending its lead in securing orders.

On March 19th, Hitachi, Ltd. announced a collaboration with NVIDIA in developing AI services. The partnership aims to digitize railways and infrastructure facilities in virtual spaces to improve maintenance efficiency.

Moreover, NVIDIA and Chinese EV companies have announced an expansion of their partnership to enhance autonomous driving technology.

While NVIDIA’s dominance seems likely to continue for the time being, we will keep a close eye on the company’s developments.

As introduced in the previous article, Sakura Internet plans to invest up to 100 billion yen over the next five years to enhance its capabilities.

Sakura Internet’s President Tanaka mentioned in the context of future management strategy, “Next term, we plan to hire up to 200 new personnel, which is double the number of this term. We aim to improve the development and operational capabilities of our data centers that store servers.”

The proactive stance is backed by the sustained expansion in demand for data centers. With the broadening base of the cloud, along with the emergence of new technologies requiring substantial computational power such as generative AI, there is a global shortage of data centers capable of performing vast computations efficiently.

Moreover, in November last year, albeit conditionally, it was selected as the provider for the foundational part of the government cloud used jointly by the government and local authorities, with the condition being “to meet all technical requirements by the end of FY2025” (Minister Kono for Digital Affairs). Following the four American entities—AWS Japan, Google Cloud Japan, Microsoft Japan, and Oracle Japan—this marks the first entry by a Japanese company.

The stock market responded to the announcement of the first government cloud certification for a Japanese company, with the stock price surging immediately after the announcement. The year-on-year price increase for 2023 placed it at the top among the listed companies on the Tokyo Stock Exchange Prime.

Capitalizing on its Japan-based operations

Unlike overseas IT giants, Sakura Internet rents out infrastructure necessary for cloud services, such as virtual servers, through its data centers, all of which are located domestically. All developers work in Japan, providing the flexibility to tailor cloud functionalities to customer needs with ease.

Among the ministries and local governments that have taken the lead in adopting the government cloud, over 90% of the 175 issued accounts have chosen AWS. However, there appears to be a significant number of local authorities wishing to use Sakura Internet’s “Hinomaru Cloud” for the protection of personal information, though the expected increase in revenue is projected to be only a few billion yen annually.

What’s important are the indirect benefits such as increased visibility and trust gained from entering the government cloud market. The company plans to leverage this to explore new business opportunities with manufacturing giants wanting to streamline operations using generative AI and major travel companies working on translation services for international visitors to Japan.

Additionally, last year, it was decided to invest approximately 13 billion yen over three years in the development of a cloud service for generative AI, “High Power”, at its data center in Hokkaido. The Ishikari Data Center is equipped with servers featuring the high-performance NVIDIA H100 Tensor Core GPU by Nvidia, aimed at uses centered around generative AI such as large language models, with the “High Power PHY” service commencing in January this year.

President Tanaka also mentioned as a medium to long-term outlook, “If we cannot provide ten times the current capacity in 3-5 years, we will not be able to meet the domestic demand.” He is seeking stable supply from Nvidia in collaboration with the Ministry of Economy, Trade and Industry to support the development of the Hinomaru Cloud.

If the data center enhancement continues in line with the GPU procurement outlook, the investment could simply amount to 100 billion yen. The generative AI-related business has a high-profit margin, and the profits generated here will be used as capital for additional investments, with the shortfall being considered for bank loans and other financing options.

Looking forward to further growth

While American IT giants are also intensifying their efforts in Japan, Sakura Internet is expected to continue its aggressive stance. Leveraging its local presence in Japan, we look forward to its further growth.

Sakura Internet, an Internet service provider that operates its own data centers equipped with Japan’s largest capacity and fastest communication lines, along with advanced security and robust infrastructure, has made a significant stride in the cloud services sector.

The company’s Infrastructure as a Service (IaaS) offering, “Sakura Cloud,” was certified in November 2023 by Japan’s Digital Agency in its call for cloud services to support government cloud infrastructure development. This certification marks a first for a Japanese company, as previously only foreign entities such as AWS, Microsoft Azure, Google Cloud, and Oracle Cloud Infrastructure were selected. This provisional certification is contingent on meeting all technical requirements by the end of fiscal year 2025.

To fulfill these requirements, Sakura Internet must significantly enhance its cloud functionalities in a short period, which hinges on acquiring exceptional IT talents capable of developing sophisticated software. The company plans to allocate grants primarily towards securing IT personnel, with a strategy to hire up to 200 individuals in the fiscal year 2024 and accelerate technological development in data storage and encryption.

Launching Cloud Services for Generative AI

Leveraging its certification as a government cloud provider, Sakura Internet is also venturing into meeting the demands of large corporations utilizing generative AI.

The development of “High Power,” a cloud service tailored for generative AI, was initiated, recognizing the critical need to ensure stable supply of computing resources for AI to advance Japan’s digital society. The service, equipped with “NVIDIA H100 Tensor Core GPUs,” commenced on January 31, 2024, with the “High Power PHY” bare-metal series. With a planned investment of 13 billion yen over three years, the company aims to expand this service further.

The newly launched “High Power PHY” features servers with eight “NVIDIA H100 Tensor Core GPUs” each and inter-server communication capabilities of 200GbE×4, designed specifically for uses such as large-scale language models central to generative AI. Moreover, the service is set to be provided from the Ishikari Data Center, operated entirely on renewable energy sources, enabling CO2 emission-free development of generative AI.

Industry Spotlight on Sakura Internet

Sakura Internet’s selection as a government cloud service provider, previously dominated by foreign companies, has garnered significant attention. Kunihiru Tanaka, the president of Sakura Internet, expressed a firm commitment to fulfilling the plan to enhance functionalities by the end of fiscal year 2025, reflecting a strong resolve. The future developments of Sakura Internet are highly anticipated within the industry.

At the turn of the year, significant announcements were made by two of the world’s leading companies, Amazon and Google, regarding data centers, which we will introduce here.

Amazon to Invest 2 Trillion Yen in Data Center Business in Japan

In January, Amazon Web Services (AWS), the world’s largest cloud service provider, announced plans to invest approximately 2.3 trillion yen in Japan over the next five years from 2023 to 2027. The investment will be allocated to expanding data centers, which are the core infrastructure for cloud services, and strengthening operational systems. This acceleration in investment is in anticipation of the explosive increase in data processing needs due to the widespread adoption of generative AI.

The Japanese subsidiary of AWS held a press conference in Tokyo on the 19th to explain its investment strategy. The total investment in facilities and operational costs for data centers in Japan, which process and store customer data, was 1.51 trillion yen over the 12 years from 2011 to 2022. Over the next five years, from 2023 to 2027, they plan to invest 2.26 trillion yen.

This massive investment exceeds the investment plan for the growth market of India, which is projected to reach 1.56 trillion rupees (approximately 1.9 trillion yen) by 2030, highlighting a clear focus on the Japanese market.

At the press conference, Tadao Nagasaki, President of AWS Japan, stated, “We aim to support the utilization of data by Japanese customers, generate various economic ripple effects, and contribute to the growth of Japan.”

Google Group Company to Construct Data Center in Cosmo Park Kata Industrial Estate in Wakayama City

The Cosmo Park Kata industrial estate in Wakayama City is a 252-hectare industrial area developed on the site where soil was extracted for the construction of Kansai International Airport.

Although the Wakayama Prefecture Land Development Corporation advanced the development, economic downturns quickly stalled the plans. The prefecture rented some of the land to promote industrial recruitment, but 87 hectares remained unsold, becoming a longstanding issue.

In this context, more than 40% of this land, totaling over 37 hectares, was sold to Ase LLC, a group company of the American IT giant Google, based in Tokyo.

The total sale price of the land is reported to be 5.94 billion yen.

Furthermore, according to Wakayama Prefecture, there are plans to construct a data center to enhance data processing speed and stability, although the details of the project plan have not been disclosed.

The process of contracting for the sale of the land is set to proceed.

Summary

With a sharp increase in cloud demand for generative AI, American Microsoft is also rushing to invest in data centers in Japan. Microsoft activated several data centers in western Japan in February last year. Google has also been operating Japan’s first data center in Inzai City, Chiba Prefecture, since March of last year. Moreover, expansion in regional areas is expected to accelerate, and we will continue to provide updates on these developments.

In December 2023, Arteria Networks Corporation and AT Tokyo Corporation decided to lay a communication optical fiber cable across Tokyo Bay, a first in Japan, connecting the Toyosu-Ariake area, which hosts a concentration of IT companies, with the Shibaura-Shinagawa area.

What underlies this decision?

The backdrop for the installation of the communication optical fiber cable includes the rapid increase in communication traffic due to changes in work styles, the rise of rich content such as video streaming, and the spread of DX, AI, and IoT, necessitating the enhancement of optical communication facilities that are vital to data centers accumulating massive data. Furthermore, communication networks, being essential social infrastructure, must not be severed under any circumstances.

To meet such societal demand, the decision was made to lay a communication optical fiber cable across Tokyo Bay, ensuring a route for data centers located on islands without relying on bridges. A notable feature is the use of the arc advancement method, considering environmental conservation.

AT Tokyo is working towards establishing a Central Third Center in the Shibaura-Shinagawa area by July 2024 as a network connection hub comparable to existing data centers, contributing to Tokyo’s information infrastructure, which brings together major financial businesses, content providers, and telecommunications operators from Japan and around the world.

Arteria Networks aims to support Tokyo as a leading technology industry and international financial city by connecting data centers in the Toyosu-Ariake area and the Shibaura-Shinagawa area provided by AT Tokyo with a high-capacity, low-latency cable route via the shortest path, offering flexible and diverse communication services.

Reasons for connecting data centers via the Tokyo Bay crossing route

The installation of this communication optical fiber cable aims to connect the Toyosu-Ariake and Shibaura-Shinagawa areas through redundant land and sea routes, enabling the use of a more reliable network infrastructure.

Existing land cable routes are at risk of flooding and liquefaction during disasters, potentially severing the network. The Tokyo Bay crossing communication optical fiber cable, installed using HDD (Horizontal Directional Drilling) method, crosses Tokyo Bay in a continuous underground conduit, ensuring a high-capacity, high-speed communication by securing an alternate route to the land, resistant to damages from ship anchors and other hazards.

Arteria Networks’ strategic initiatives in the data center business

The Inzai area in Chiba Prefecture has been deemed suitable for data center operations due to the strength of its ground, high accessibility to Tokyo and Narita, and connectivity to the submarine cable landing stations in northern Ibaraki and southern Boso in Chiba. In 2021, Arteria Networks announced the installation of a dedicated line facility capable of up to 100Gbps at the NRT10 data center being constructed by MC Digital Realty in the Inzai area of Chiba Prefecture. The laying of the communication optical fiber cable across Tokyo Bay is backed by Arteria Networks’ longstanding strategic efforts, with further advancements expected in the future.

As previously reported, NTT and Tokyo Electric Power have jointly established a new company and agreed to jointly develop data center and battery storage businesses. This time, I will focus on introducing the battery storage business.

Outlook for the Battery Storage Business

NTT Anode Energy and Tokyo Electric Power Holdings have agreed to expand the application area of batteries and reduce costs at the Tsumagoi Battery Storage facility. This storage facility will use lithium-ion batteries, with a capacity of 9.3MWh and an output of 2MW.

Moving forward, both companies plan to use their assets and know-how in electricity and telecommunications to meet increasingly sophisticated social needs, such as carbon neutrality, and aim to create new value and become leaders in building a sustainable society.

So, why focus on battery development?

The Importance of Batteries in Data Center Operations

Data centers consume a massive amount of electricity, necessitating the use of renewable energy. However, ensuring a stable supply of vast amounts of power is a challenge. This is because the power generation from renewable energy varies depending on weather and time. While short-term fluctuations can be covered by UPS (Uninterruptible Power Supply) and emergency generators, they are not sufficient for frequent disruptions and pose a critical flaw for data center services. The use of batteries allows for coping with these fluctuations in power generation, enabling a stable supply of renewable energy. This is expected to promote the use of environmentally friendly energy in data center operations. Although the use of batteries has been considered before, their implementation in data centers has not progressed due to both the capacity of power storage and cost.

Expectations for the Technology and Initiatives of Both Companies

Battery technology is an extremely important theme across the industrial world, particularly in the data center industry. The path to addressing this theme is anticipated to advance through the establishment of a new company by NTT and Tokyo Electric Power, focusing on the development of large-capacity batteries in MW units and cost reduction, leading to widespread adoption in the data center industry.

Tokyo Electric Power Holdings and NTT announced on December 19, 2023, two new initiatives in their collaborative business.

Data Center Business

The first is the data center business. NTT Data Group, NTT Global Data Centers, and Tokyo Electric Power Grid have agreed to jointly develop and operate a new company in the Inzai Shirai area of Chiba Prefecture, aimed at establishing a data center. They plan to establish a special purpose company within the fiscal year 2023, develop a data center with a power capacity of 50 MW, and aim to open and start services in the second half of fiscal 2026.

With the proliferation of generative AI, there is an expected increase in demand for data centers. Both companies have indicated a policy to leverage their expertise to aim for an advanced data center model, taking into account the realization of carbon neutrality.

Storage Power Plant Launch

The second initiative is the storage power plant business by TEPCO Holdings and NTT Anode Energy. In November, they established a limited liability company, ‘Tsumagoi Storage Power Plant LLC’, in Tsumagoi Village, Agatsuma District, Gunma Prefecture. They are preparing for the construction of the storage power plant and other preparations, aiming to start the business in 2025.

In the context of advancing the introduction and utilization of renewable energy towards the realization of carbon neutrality by 2050, issues such as securing adjustment power and enhancing the power system that become necessary are becoming evident.

To address these issues, TEPCO Holdings and NTT Anode Energy have been utilizing batteries in their efforts. By bringing together the expertise both companies have cultivated and collaborating in the increasingly necessary storage power plant business, they aim to expand the application area of batteries, reduce costs, and further develop the storage power plant business.

Future Trends Worthy of Attention

In 2020, the power consumption of data centers accounted for 2.1% of the total power consumption (913.5 billion kWh), an increase from about 1.4% in 2018. Furthermore, according to a report by the International Institute for Environmental Economics, if the trend of increasing computational load continues into the future, it is expected to reach 90 TWh domestically by 2030.

The establishment of new companies by NTT and TEPCO, Japan’s largest data center operators, to meet the growing power demand in a carbon-neutral way is garnering attention from the entire industry.

As this is an important topic in discussing Japan’s data center market, we will continue to follow these developments.”