The construction "I, too, have a car" is grammatically acceptable. (You can technically also write it without the commas as you did -- "I too have a car" -- although, personally, I think the commas help clarify, at least in the written form.)
The dictionary says when it is used as “ I too.” (Period), then it’s wrong.