Oily skin tends to get oilier when it's not getting enough moisture. So whilst things like clay masks are good to get rid of excess oil, they can also dry your skin out too much, which leads to sebum overproduction - a vicious cycle. So don't use them more than 2x a week, or only apply to the oily areas (like T zone).
For oily skin I would recommend gel cleanser, something not too stripping. If you use a hydrating toner, apply it to damp skin. Use a serum with niacinamide to help control oil production. Use a lighter gel moisturiser in the day but try a richer one for the night time.
I personally do not use oil cleansers or other oil products because they clog my pores, but I know lots of people swear by them.
On the bright side, oily skin tends to age slower so that's something ๐๐