It depends on what airline you work for and who your DO is.
1) If he is a rpick (as most are) he will try to find a reason to blame the PIC. Then ALPA will step in after your fired. About 6 months later you will get your job back with retro pay. The ramper who pushed you back and the DO will still have their jobs.
2) If he is reasonable, they will launch a full investigation (CVR/FDR -- was the crew talking about politics or was it sterile cockpit,) the rampers/wing walkers/tug drivers will get drug tested. Ramp cameras will be reviewed. If they determine it happened while the aircraft was under the control of the tug, and the flight crew gave the correct instructions from the ramp tower to the tug driver, the flight crew will be fine.
The tug driver will again keep his job because, at the money they pay, the airline won't be able to find a qualififed replacement.