Some members of Congress are skeptical about White House's plans to bring feds back to the office