yoga is meant to be a spiritual, mental and psychical discipline and practice.
yoga, tai-chi etc are specifically meant to create a mind, body soul impact, they arent just a work out
if youre seriously not into that aspect of it try finding a studio that does a yoga mix type work out that doesnt focus on the meditation part, depending where you live im sure you can find one. there is almost always a meditation aspect of yoga and it isnt a short one,
alternatively you could buy some home practices and skip the meditation part
ive done yoga for years, and usually the meditation part rounds to be about 5-10 mins at the end of it and 5-10 mins in the beginning.