Also, if you mean "Eastern Standard Time" and "Eastern Daylight Time" then they are the same time zone and no conversion is necessary. It doesn't make sense to ask for a time to be formatted as if it were daylight saving time, if it isn't.
I had tried like what you had described but it is displaying GMT as its time zone when we set the TimeZone in the code "df.setTimeZone(TimeZone.getTimeZone("EDT"));" My requirement is to display the time zone as EDT always without any loss of time.