I thought it was illegal to remove them, but it's not. Just not recommended, as you can spread diseases. Tadpoles are produced in huge numbers, only a few will make it to breeding adults.
They should keep OK in a tank with pond water, if you feed them. I don't think tap water will be good for them. And return them to where you took them from when they are wee frogs.