Yes you could add it to your soil, just a layer on top and it will gradually be worked in as worms push casts above it. I am not sure of any major benefit to be honest, if you are adding enough organic matter the drainage should be good, and there are no nutrients in sand.
It would be useful to mix with homemade compost for potting, where drainage and air are so important.
