From what I've seen online, unless you're getting tight timing and very fast DDR5, you probably wouldn't see much of a difference.
Maybe if you upgrade every year or two, it could make sense to go DDR5, because you could potentially reuse it at that point. But if your upgrade cycle is longer, may as well just use the DDR4 you already have.