Why did they not have the 2004 Olympics?

Answer 1

Prior to 1992 both summer and winter Olympics were held in the same calendar year. After that year it was decided that the winter Olympics should be held in the off two years from the summer Olympics so in 1994 the winter Olympics were held in Lillihammer, Norway just two years after the previous winter Olympics.

http://en.wikipedia.org/wiki/Winter_Olympic_Games

Answer 2

To provide some separation from the Summer Olympics, the Winter Olympics altered their schedule in 1994. Rather than waiting until 1996, after the 1992 games in Albertville, France, they held the next Winter Olympics in 1994 in Lillehammer, Norway. After that, they've held Winter Olympics every four years from 1994. There were no Winter Olympics in 2004, but they were held in 2002 and 2006.

Answer 3

The 2004 Olympic Games were held in Athens, Greece