Nvidia Declares That It Is A Full-Stack Platform – The Next Platform
Posted: November 14, 2021 at 1:46 am
In a decade and a half, Nvidia has come a long way from its early days as a provider of graphics chips for personal computers and other consumer devices.
Jensen Huang, Nvidia co-founder and chief executive officer, put his sights on the datacenter, pushing GPUs as a way of accelerating HPC applications and the CUDA software development environment as a way of making that happen. Five years later, Huang declared artificial intelligencethe future of computing and that Nvidia would not only enable that, but bet the company on this being the future of software development that AI-enhanced everything would be, in fact, the next platform.
The company has continued to evolve, expanding its hardware and software capabilities aimed at meeting the demands of an ever-changing IT landscape that now includes multiple clouds and the fast-growing edge and, Huang expects, a virtual world of digital twins and avatars, and all of this dependent on the companys technologies.
Nvidia has not been a point product provider for some time, but is now a full-stack platform vendor for this new computing world.
Accelerated computing starts with Nvidia CUDA general-purpose programmable GPUs, Huang said during his keynote address at the companys virtual GTC 2021 event this week. The magic of accelerated computing comes from the combination of CUDA, the acceleration libraries of algorithms that speed-up applications and the distributed computing systems and software that scale processing across an entire datacenter.
Nvidia has been advancing CUDA and expanding the surrounding ecosystem for it for more than fifteen years.
We optimize across the full stack, iterating between GPU, acceleration libraries, systems, and applications continuously, all the while expanding the reach of our platform by adding new application domains that we accelerate, he said. With our approach, end users experience speedups through the life of the product. It is not unusual for us to increase application performance by many X-factors on the same chip over several years. As we accelerate more applications, our network of partners see growing demand for Nvidia platforms. Starting from computer graphics, the reach of our architecture has reached deep into the worlds largest industries. We start with amazing chips, but for each field of science, industry and application, we create a full stack.
To illustrate that, Huang pointed to the more than 150 software development kits that target a broad range of industries, from design to life sciences, and at GTC announced 65 new or updated SDKs touching on such areas as quantum computing, cybersecurity, and robotics. The number of developers using Nvidia technologies has grown to almost three million, increasing six-fold over the past five years. In addition, CUDA has been downloaded 30 million times over 15 years, including seven million times last year.
Our expertise in full-stack acceleration and datacenter-scale architectures lets us help researchers and developers solve problems at the largest scales, he said. Our approach to computing is highly energy-efficient. The versatility of architecture lets us contribute to fields ranging from AI to quantum physics to digital biology to climate science.
That said, Nvidia is not without its challenges. The companys $40 billion bid for Arm is no sure thing, with regulators from the UK and Europe saying they want to take a deeper look at the possible market impacts the deal would create and Qualcomm leading opposition to the proposed acquisition. In addition, the competition in GPU-accelerated computing is heating up, with AMD advancing its capabilities we recently wrote about the companys Aldebaran Instinct MI200 GPU accelerator and Intel last week saying that it expects the upcoming Aurora supercomputer will scale beyond 2 exaflops due in large part to a better-than-expected performance by its Ponte Vecchio Xe HPC GPUs.
Still, Nvidia sees its future in creating the accelerated-computing foundation for the expansion of AI, machine learning and deep learning into a broad array of industries, as illustrated by the usual avalanche of announcements coming out of GTC. Among the new libraries was ReOpt, which is aimed finding the shortest and most efficient routes for getting products and services to their destinations, which can save companies time and money in last-mile delivery efforts.
CuQuantum is another library for creating quantum simulators to validate research in the field while the industry builds the first useful quantum computers. Nvidia has built a cuQuantum DGX appliance for speeding up quantum circuit simulations, with the first accelerated quantum simulator coming to Googles Cirq framework coming in the first quarter 2022. Meanwhile, cuNumeric is aimed at accelerating NumPy workloads, scaling from one GPU to multi-node clusters.
Nvidias new Quantum-2 interconnect (which has nothing to do with quantum computing) is a 400 Gb/sec InfiniBand platform that comprises the Quantum-2 switch, the ConnectX-7 SmartNIC, the BlueField 3 DPU, and features like performance isolation, a telemetry-based congestion-control system and 32X higher in-switch processing for AI training. In addition, nanosecond timing will enable cloud datacenters to get into the telco space by hosting software-defined 5G radio services.
Quantum-2 is the first networking platform to offer the performance of a supercomputer and the shareability of cloud computing, Huang said. This has never been possible before. Until Quantum-2, you get either bare-metal high-performance or secure multi-tenancy. Never both. With Quantum-2, your valuable supercomputer will be cloud-native and far better utilized.
The 7 nanometer InfiniBand switch chip holds 57 billion transistors similar to Nvidias A100 GPU and has 64 ports running at 400 Gb/sec or 128 ports running at 200 Gb/sec. A Quantum-2 system can connect up to 2,048 ports, as compared to the 800 ports with Quantum-1. The switch is sampling now and comes with options for the ConnectX-7 SmartNIC sampling in January or BlueField 3 DPU, which will sample in May.
BlueField DOCA 1.2 is a suite of cybersecurity capabilities that Huang said will make BlueField an even more attractive platform for building a zero-trust architecture by offloading infrastructure software that is eating up as much as 30 percent of CPU capacity. In addition, Nvidias Morpheus deep-learning cybersecurity platform uses AI to monitor and analyze data from users, machines and services to detect anomalies and abnormal transactions.
Cloud computing and machine learning are driving a reinvention of the datacenter, Huang said. Container-based applications give hyperscalers incredible abilities to scale out, allowing millions to use their services concurrently. The ease of scale out and orchestration comes at a cost: east-west network traffic increased incredibly with machine-and-machine message passing and these disaggregated applications open many ports inside the datacenter that need to be secured from cyberattack.
Nvidia has bolstered its Triton Inferencing Server with new support for the Arm architecture; the system already supported Nvida GPUs and X86 chips from Intel and AMD. In addition, version 2.15 of Triton also can run multiple GPU and multi-node inference workloads, which Huang called arguably one of the most technically challenging runtime engines the world has ever seen.
As these models are growing exponentially, particularly in new use cases, theyre often getting too big for you to run on a single CPU or even a single server, Ian Buck, vice president and general manager of Nvidias Tesla datacenter business, said during a briefing with journalists. Yet the demands [and] the opportunities for these large models want to be delivered in real time. The new version of Triton actually supports distributed inference. We take the model and we split it across multiple GPUs and multiple servers to deliver that to optimize the computing to deliver the fastest possible performance of these incredibly large models.
Nvidia also unveiled NeMo Megatron, a framework for training large language models (LLMs) that have trillions of parameters. NeMo Megatron can be used for such jobs as language translation and compute program writing, and it leverages the Triton Inference Server. Nvidia last month unveiled Megatron 530B, a language mode with 530 billion parameters.
The recent breakthrough of large language models is one of the great achievements in computer science, Huang said. Theres exciting work being done in self-supervised multi-modal learning and models that can do tasks that it was never trained on called zero-shot learning. Ten new models were announced last year alone. Training LLMs is not for the faint of heart. Hundred-million-dollar systems, training trillion-parameter models on petabytes of data for months requires conviction, deep expertise, and an optimized stack.
A lot of time at the event was spent on Nvidias Omniverse platform, the virtual environment introduced last year that the company believes will be a critical enterprise tool in the future. Skeptics point to avatars and the like in suggesting that Omniverse is little more than a second coming of Second Life. In responding to a question, Buck said there are two areas where Omniverse is catching on in the enterprise.
The first is digital twins virtual representations of machines or systems that recreate an environment like the work were doing in embedded and robotics and other places to be able to simulate virtual worlds, actually simulate the products that are being built in a virtual environment and be able to prototype them entirely with Omniverse. A virtual setting allows the product development to happen in a way that has been before remotely, virtually around the world.
The other is in the commercial use of virtual agents this is where the AI-based avatars can come in to help with call centers and similar customer-facing tasks.
Read more:
Nvidia Declares That It Is A Full-Stack Platform - The Next Platform
- Intel Achieves Milestone in Quantum Practicality with 'Horse Ridge' - Database Trends and Applications [Last Updated On: December 21st, 2019] [Originally Added On: December 21st, 2019]
- 2-Day Conference: The Future of Quantum Computing, Networking & Sensors (New York, United States - April 2-3, 2020) - Benzinga [Last Updated On: December 21st, 2019] [Originally Added On: December 21st, 2019]
- IBM and the University of Tokyo Launch Quantum Computing Initiative for Japan - Quantaneo, the Quantum Computing Source [Last Updated On: December 21st, 2019] [Originally Added On: December 21st, 2019]
- What We Learned in Science News 2019 - The New York Times [Last Updated On: December 21st, 2019] [Originally Added On: December 21st, 2019]
- IBM and the U. of Tokyo launch quantum computing initiative for Japan | - University Business [Last Updated On: December 21st, 2019] [Originally Added On: December 21st, 2019]
- 2020 and beyond: Tech trends and human outcomes - Accountancy Age [Last Updated On: December 21st, 2019] [Originally Added On: December 21st, 2019]
- The Quantum Computing Decade Is ComingHeres Why You Should Care - Observer [Last Updated On: December 21st, 2019] [Originally Added On: December 21st, 2019]
- Donna Strickland appointed to Order of Canada - University of Rochester [Last Updated On: December 30th, 2019] [Originally Added On: December 30th, 2019]
- 20 technologies that could change your life in the next decade - Economic Times [Last Updated On: December 30th, 2019] [Originally Added On: December 30th, 2019]
- 5 open source innovation predictions for the 2020s - TechRepublic [Last Updated On: December 30th, 2019] [Originally Added On: December 30th, 2019]
- The 5 Most Important Federal Government Tech Predictions to Watch in 2020 - Nextgov [Last Updated On: December 30th, 2019] [Originally Added On: December 30th, 2019]
- Information teleported between two computer chips for the first time - New Atlas [Last Updated On: December 30th, 2019] [Originally Added On: December 30th, 2019]
- How This Breakthrough Makes Silicon-Based Qubit Chips The Future of Quantum Computing - Analytics India Magazine [Last Updated On: December 30th, 2019] [Originally Added On: December 30th, 2019]
- Quantum Supremacy and the Regulation of Quantum Technologies - The Regulatory Review [Last Updated On: December 30th, 2019] [Originally Added On: December 30th, 2019]
- Physicists Just Achieved The First-Ever Quantum Teleportation Between Computer Chips - ScienceAlert [Last Updated On: December 30th, 2019] [Originally Added On: December 30th, 2019]
- The 12 Most Important and Stunning Quantum Experiments of 2019 - Livescience.com [Last Updated On: December 30th, 2019] [Originally Added On: December 30th, 2019]
- Memorial ceremony held for Peter Wittek, U of T professor who went missing in India - Varsity [Last Updated On: February 10th, 2020] [Originally Added On: February 10th, 2020]
- Is quantum innovation the future of tech? - GovInsider [Last Updated On: February 10th, 2020] [Originally Added On: February 10th, 2020]
- Enterprise hits and misses - quantum gets real, Koch buys Infor, and Shadow's failed app gets lit up - Diginomica [Last Updated On: February 10th, 2020] [Originally Added On: February 10th, 2020]
- White House reportedly aims to double AI research budget to $2B - TechCrunch [Last Updated On: February 10th, 2020] [Originally Added On: February 10th, 2020]
- Opinion | Prepare for a world of quantum haves and have-nots - Livemint [Last Updated On: February 10th, 2020] [Originally Added On: February 10th, 2020]
- White House Earmarks New Money for A.I. and Quantum Computing - The New York Times [Last Updated On: February 10th, 2020] [Originally Added On: February 10th, 2020]
- New Particle Accelerator In New York To Probe Protons And Neutrons - Here And Now [Last Updated On: February 12th, 2020] [Originally Added On: February 12th, 2020]
- NASA Soars and Others Plummet in Trump's Budget Proposal - Scientific American [Last Updated On: February 12th, 2020] [Originally Added On: February 12th, 2020]
- For the tech world, New Hampshire is anyone's race - Politico [Last Updated On: February 12th, 2020] [Originally Added On: February 12th, 2020]
- Quantum Internet Workshop Begins Mapping the Future of Quantum Communications - HPCwire [Last Updated On: February 12th, 2020] [Originally Added On: February 12th, 2020]
- Quantum Computing: How To Invest In It, And Which Companies Are Leading the Way? - Nasdaq [Last Updated On: February 12th, 2020] [Originally Added On: February 12th, 2020]
- Deltec Bank, Bahamas Quantum Computing Will have Positive Impacts on Portfolio Optimization, Risk Analysis, Asset Pricing, and Trading Strategies -... [Last Updated On: March 15th, 2020] [Originally Added On: March 15th, 2020]
- NIST Works on the Industries of the Future in Buildings from the Past - Nextgov [Last Updated On: March 15th, 2020] [Originally Added On: March 15th, 2020]
- Top AI Announcements Of The Week: TensorFlow Quantum And More - Analytics India Magazine [Last Updated On: March 15th, 2020] [Originally Added On: March 15th, 2020]
- Army Project Touts New Error Correction Method That May be Key Step Toward Quantum Computing - HPCwire [Last Updated On: March 15th, 2020] [Originally Added On: March 15th, 2020]
- IDC Survey Finds Optimism That Quantum Computing Will Result in Competitive Advantage - HPCwire [Last Updated On: March 15th, 2020] [Originally Added On: March 15th, 2020]
- Inside the race to build the best quantum computer on Earth - Economic Times [Last Updated On: March 15th, 2020] [Originally Added On: March 15th, 2020]
- Honeywell Claims to Have Built the "Most Powerful" Quantum Computer - Interesting Engineering [Last Updated On: March 15th, 2020] [Originally Added On: March 15th, 2020]
- Tech reality check: business must move beyond the hype on digital technology - CBI [Last Updated On: March 28th, 2020] [Originally Added On: March 28th, 2020]
- Quantum Computing Market 2020 | Growing Rapidly with Significant CAGR, Leading Players, Innovative Trends and Expected Revenue by 2026 - Skyline... [Last Updated On: March 28th, 2020] [Originally Added On: March 28th, 2020]
- Reaching the Singularity May be Humanity's Greatest and Last Accomplishment - Air & Space Magazine [Last Updated On: March 28th, 2020] [Originally Added On: March 28th, 2020]
- Flux-induced topological superconductivity in full-shell nanowires - Science Magazine [Last Updated On: March 28th, 2020] [Originally Added On: March 28th, 2020]
- Research by University of Chicago PhD Student and EPiQC Wins IBM Q Best Paper - Quantaneo, the Quantum Computing Source [Last Updated On: March 28th, 2020] [Originally Added On: March 28th, 2020]
- Picking up the quantum technology baton - The Hindu [Last Updated On: March 28th, 2020] [Originally Added On: March 28th, 2020]
- Devs: Alex Garland on Tech Company Cults, Quantum Computing, and Determinism - Den of Geek UK [Last Updated On: March 28th, 2020] [Originally Added On: March 28th, 2020]
- 1000 Words or So About The New QuantumAI Scam - TechTheLead [Last Updated On: April 6th, 2020] [Originally Added On: April 6th, 2020]
- What Lies In the Future of Mechanical Design Industry - Interesting Engineering [Last Updated On: April 6th, 2020] [Originally Added On: April 6th, 2020]
- 3 High-Growth Trends to Invest In Now - Investorplace.com [Last Updated On: April 6th, 2020] [Originally Added On: April 6th, 2020]
- Inside the Global Race to Fight COVID-19 Using the World's Fastest Supercomputers - Scientific American [Last Updated On: April 6th, 2020] [Originally Added On: April 6th, 2020]
- Quantum computing at the nanoscale - News - The University of Sydney [Last Updated On: April 6th, 2020] [Originally Added On: April 6th, 2020]
- Here's when we can expect the next major leap in quantum computing - TechRepublic [Last Updated On: April 6th, 2020] [Originally Added On: April 6th, 2020]
- Quantum Computing: What You Need To Know - Inc42 Media [Last Updated On: April 6th, 2020] [Originally Added On: April 6th, 2020]
- How quantum computing will be used to model elections - TechRepublic [Last Updated On: April 6th, 2020] [Originally Added On: April 6th, 2020]
- Quantum Computing Startup Raises $215 Million for Faster Device - Bloomberg [Last Updated On: April 6th, 2020] [Originally Added On: April 6th, 2020]
- More free, discounted tech for governments responding to COVID-19 - GCN.com [Last Updated On: April 10th, 2020] [Originally Added On: April 10th, 2020]
- Securing IoT in the Quantum Age - Eetasia.com [Last Updated On: April 10th, 2020] [Originally Added On: April 10th, 2020]
- Microsoft invests in PsiQuantum, a startup which is building the worlds first useful quantum computer - MSPoweruser - MSPoweruser [Last Updated On: April 10th, 2020] [Originally Added On: April 10th, 2020]
- RAND report finds that, like fusion power and Half Life 3, quantum computing is still 15 years away - The Register [Last Updated On: April 10th, 2020] [Originally Added On: April 10th, 2020]
- Pentagon wants commercial, space-based quantum sensors within 2 years - The Sociable [Last Updated On: April 19th, 2020] [Originally Added On: April 19th, 2020]
- Defense budget cuts following the pandemic will be hard to swallow | TheHill - The Hill [Last Updated On: April 19th, 2020] [Originally Added On: April 19th, 2020]
- Science of Star Trek - The UCSB Current [Last Updated On: April 19th, 2020] [Originally Added On: April 19th, 2020]
- Quantum Computing Market 2020 Break Down by Top Companies, Applications, Challenges, Opportunities and Forecast 2026 Cole Reports - Cole of Duty [Last Updated On: April 19th, 2020] [Originally Added On: April 19th, 2020]
- World coronavirus Dispatch: Quantum Computing Market Recent Trends and Developments, Challenges and Opportunities, key drivers and Restraints over the... [Last Updated On: April 19th, 2020] [Originally Added On: April 19th, 2020]
- The future of quantum computing in the cloud - TechTarget [Last Updated On: April 19th, 2020] [Originally Added On: April 19th, 2020]
- Quantum computing heats up down under as researchers reckon they know how to cut costs and improve stability - The Register [Last Updated On: April 19th, 2020] [Originally Added On: April 19th, 2020]
- Quantum Computing With Particles Of Light: A $215 Million Gamble - Forbes [Last Updated On: April 19th, 2020] [Originally Added On: April 19th, 2020]
- Hot Qubits Could Deliver a Quantum Computing Breakthrough - Popular Mechanics [Last Updated On: April 19th, 2020] [Originally Added On: April 19th, 2020]
- New way of developing topological superconductivity discovered - Chemie.de [Last Updated On: April 28th, 2020] [Originally Added On: April 28th, 2020]
- Deltec Bank, Bahamas - Quantum Computing Will bring Efficiency and Effectiveness and Cost Saving in Baking Sector - marketscreener.com [Last Updated On: April 28th, 2020] [Originally Added On: April 28th, 2020]
- Muquans and Pasqal partner to advance quantum computing - Quantaneo, the Quantum Computing Source [Last Updated On: April 28th, 2020] [Originally Added On: April 28th, 2020]
- Wiring the Quantum Computer of the Future: Researchers from Japan and Australia propose a novel 2D design - QS WOW News [Last Updated On: April 28th, 2020] [Originally Added On: April 28th, 2020]
- Announcing the IBM Quantum Challenge - Quantaneo, the Quantum Computing Source [Last Updated On: April 28th, 2020] [Originally Added On: April 28th, 2020]
- Trump betting millions to lay the groundwork for quantum internet in the US - CNBC [Last Updated On: April 28th, 2020] [Originally Added On: April 28th, 2020]
- Doctor Strange might want to trade his Time Stone for time crystals that are doing some otherworldly things - SYFY WIRE [Last Updated On: August 23rd, 2020] [Originally Added On: August 23rd, 2020]
- Quantum Information Processing Market 2020 | Know the Latest COVID19 Impact Analysis And Strategies of Key Players: 1QB Information Technologies,... [Last Updated On: August 23rd, 2020] [Originally Added On: August 23rd, 2020]
- Scientists Have Shown There's No 'Butterfly Effect' in the Quantum World - VICE [Last Updated On: August 23rd, 2020] [Originally Added On: August 23rd, 2020]
- This Twist on Schrdinger's Cat Paradox Has Major Implications for Quantum Theory - Scientific American [Last Updated On: August 23rd, 2020] [Originally Added On: August 23rd, 2020]
- A Meta-Theory of Physics Could Explain Life, the Universe, Computation, and More - Gizmodo [Last Updated On: August 23rd, 2020] [Originally Added On: August 23rd, 2020]
- This Week's Awesome Tech Stories From Around the Web (Through August 22) - Singularity Hub [Last Updated On: August 23rd, 2020] [Originally Added On: August 23rd, 2020]
- Will Quantum Computers Really Destroy Bitcoin? A Look at the Future of Crypto, According to Quantum Physicist Anastasia Marchenkova - The Daily Hodl [Last Updated On: August 23rd, 2020] [Originally Added On: August 23rd, 2020]
- Has the world's most powerful computer arrived? - The National [Last Updated On: August 23rd, 2020] [Originally Added On: August 23rd, 2020]
- What Is Quantum Supremacy And Quantum Computing? (And How Excited Should We Be?) - Forbes [Last Updated On: August 23rd, 2020] [Originally Added On: August 23rd, 2020]
- Vitalik Buterin highlights major threats to Bitcoin BTC and Ethereum ETH - Digital Market News [Last Updated On: September 2nd, 2020] [Originally Added On: September 2nd, 2020]
- Two Pune Research Institutes Are Building India's First Optical Atomic Clocks - The Wire Science [Last Updated On: September 2nd, 2020] [Originally Added On: September 2nd, 2020]