Unlike some other military teams, such as Luftwaffen-SV Hamburg, the side did not participate in regular German league play or take part in national championship play, but instead staged a series of exhibition matches in Germany, as well as a few in Hungary, Alsace (France), and Poland.
The genesis of the team was in a challenge made by an elite Romanian army side to Graf, who managed the German military side in the country. Graf trained with Germany's national side before the war and he decided to contact his former coach, Sepp Herberger, who – to the surprise of the Romanians – brought along several members of the side to take part in the match, which the Germans won 3:2 in front of 40,000 in Bucharest.
By 1943, Graf had decided to act to save as many of the national team's players as he could from frontline service, attaching them to his unit – the Luftlandebrigade 26 (en: 26th Airborne Brigade) – as "technical experts". Among those who played for the Jäger was Fritz Walter who would go on to fame with 1. FC Kaiserslautern and earn 61 caps with Germany. He wrote the book 11 Rote Jäger about his experiences.
German military clubs were disbanded in September 1944 as Allied armies began their advance into the country. Still, the Rote Jäger managed to play two more games in Cracow in November 1944, the last of these in front of 20,000 German soldiers.