Nvidia unveils a new AI chip: GH200 (compare)

[LechM]

https://nvidianews.nvidia.com/news/g...h-hbm3e-memory

The GH200 will feature the same GPU as Nvidia's H100 but will have more memory: 140 GB compared to 80 GB. Its HBM3e memory will also be 50% faster than the current HBM3. This GPU can be set up in a dual configuration, but it won't be released until 2024. Memory constraints often limit the deployment of large models, such as those used for text generation.