When we built our garage three years ago I planned a 60 A panel for it, based on the fact that a common EV charger type is up to 40 A. Since I was going to run buried cable out to the garage from the house (about 140 ft of cable), I checked with a contractor for that installation part. He advised that future changers are headed to 60 A, and might even go higher, so I should consider a 100 A panel and feed cable. Like you, I winced at the cost of that! Shortly after as I consulted an electrical inspector on another matter he advised I check the price of Aluminum buried cable instead of copper for a much better price, so I asked the contractor for a revised quote. He came back surprised at the difference. Going that way at 100 A feed versus 60 A in copper cable, the saving was more than enough to pay for the larger 100 A panel in the garage. So that's what I did. As it happened, when I got it done, the local supply houses did not have 00 Aluminum buried cable in stock, so they got 000 for a sightly higher price. That is rated for 115 A, but if you de-rate that for the cable length it's 105 A. With the light other uses in the garage (no heavy equipment), I could install two 40 A chargers (we have three cars in the family) or one really heavy charger - whatever is needed for future car purchases.
Don't forget this factor. Although a charger may actually deliver 30 A current to the car, it is rated at 40 A in terms of the wiring required. That is because a general "rule" in wiring is that the circuit should be designed so that the NORMAL sustained max current does not exceed 80% of component capacity. For example, a common laundry electric dryer with a 4000 W heating element needs 18 A for the heater plus 10 A for the ¼ HP motor, total 28 A max sustained current in operation. That requires at least a 35 A cable and breaker from the panel.