American eagle jeans size!!

Ke

So I am a waist of 26 but American eagle jeans are usually stretchy...so I got a size 4 which is waist 26 well they are a bit big not too much but I have to have a belt...well there’s a size 2 that’s a waist 25 and it’s super stretch...do yal think if I go from a size 4 to a size 2 it will fit...considering they are stretch material??