Next Gen ARM Server
NVIDIA GeForce RTX 4070 is on 5nm, 12GDDR6X and a die size of ~300mm2. RSP At $599.
On 5nm or 4nm, so may be 2024 I am optimistic that we could have a Server / Node with 64 Core ARM CPU within the same die size and 64GB of ECC DDR5 Memory ( ~$350 BOM ). If we add 1TB x 2 SSD ( $150BOM ) and 10Gbps Ethernet, ( $100 BOM ), that is roughly additional $600. The whole RSP shouldn't cost more than $1999.
For Server, that is amortised over 24 Months if not more, you could be paying $100 per month for the Bare Metal. This is excluding any economy of scale. Once this get standardised into node and 1U form factor, the cost of Server computing will drop significantly.
The problem is there doesn't seems to be anyone who wants to disrupt this market.
Hetzner current has [1] their RX line with Ampere Altra Q80 Core, that is a 7nm ~600mm2 Die size beast and 8 memory channel. 128GB Memory, costing roughly $200 USD per month.