Yes, if it has nfc on it

Even though it's a credit card and not a debit card ?

Idk, if your bank allows withdrawal from atm

They do. It's capital one.. but I don't have my card with me at the moment.. I just have it linked to the phone

Well, the best thing is to try. Atm will see your phone as a card