Which Factory pattern do you mean? The only well defined "factory" patterns I know are Abstract Factory and Factory Method.
And what is your goal in using that pattern? What are you trying to accomplish? What design forces do you feel?
The soul is dyed the color of its thoughts. Think only on those things that are in line with your principles and can bear the light of day. The content of your character is your choice. Day by day, what you do is who you become. Your integrity is your destiny - it is the light that guides your way. - Heraclitus