The entry for goose-step says:
In reference to “marching without bending the knees” (as in Nazi military reviews) it apparently is first recorded 1916.
In “The Yellow Peril” by Jack London, 1904, is this sentence:
It required no revolution of his nature to learn to calculate the range and fire a field-gun or to march the goose-step.