iso-2022-jp loading problem

[Rob Shields]

Trying to load and display some iso-2022-jp characters, but they just look like garbage. Tested with Java 1.5 and 6. It's supposed to look like this:

纊鍈昱曻伀佖侔倞傔冝匀咜喆埇夋奣孖寘

File is saved here.

Here's the code I'm using to load and display:

import java.awt.Font;
import java.io.File;
import java.io.FileInputStream;
import java.io.IOException;
import java.io.InputStream;
import java.io.InputStreamReader;
import java.io.Reader;
 
import javax.swing.JFrame;
import javax.swing.JLabel;
import javax.swing.JTextPane;
 
public class Viewer {
  
  /*
   * HelloWorldSwing.java requires no other files. 
   */
 
    /**
     * Create the GUI and show it.  For thread safety,
     * this method should be invoked from the
     * event-dispatching thread.
     */
    private static void createAndShowGUI() throws IOException {
        //Create and set up the window.
        JFrame frame = new JFrame("HelloWorldSwing");
        frame.setDefaultCloseOperation(JFrame.EXIT_ON_CLOSE);
 
        //Add the ubiquitous "Hello World" label.
        JLabel label = new JLabel("Hello World");
        frame.getContentPane().add(label);
        
        InputStream is = new FileInputStream(new File("JISCharacters.txt"));
        Reader r = new InputStreamReader(is, "iso-2022-jp");
        // r = new RemoveHTMLReader(r);
        StringBuffer sb = new StringBuffer();
        int i;
        while ((i = r.read()) != -1) {
          char c = (char) i;
          sb.append(c);
        }
        
        JTextPane textPane = new JTextPane();
        textPane.setText(sb.toString());
        Font font = new Font("Kochi Gothic", 0, 24);
        textPane.setFont(font);
        frame.getContentPane().add(textPane);
 
        //Display the window.
        frame.pack();
        frame.setVisible(true);
    }
 
    public static void main(String[] args) {
        //Schedule a job for the event-dispatching thread:
        //creating and showing this application's GUI.
        javax.swing.SwingUtilities.invokeLater(new Runnable() {
            public void run() {
              try {
                createAndShowGUI();
              } catch (IOException ioe) {
                System.out.println(ioe);
              }
            }
        });
    }
}

You may have to change the font for your system. It's definitely not the font, since I have successfully loaded and displayed the following HTML-encoded version of the text:

纊鍈昱曻伀佖侔倞=
 
傔冝匀咜喆埇夋奣孖&=
 
#23512;

[Rob Shields]

Oops, that HTML-encoded text should look like:

纊鍈昱曻伀佖侔倞傔冝匀咜喆埇夋奣孖寘

Just as a correction, it doesn't actually look like garbage when is displayed, it looks like this:

������������������

The file I linked to displays properly in a web browser when you select iso-2022-jp as the encoding.

However, when I copy the text from my browser into a new text file in gedit and hit file -> save as and choose iso-2022-jp as the encoding, it says:

The document contains one or more characters that cannot be encoded using the specified character coding.
Select a different character coding from the menu and try again.

I guess this may be a clue.

[Rob Shields]

I notice that the file starts with the iso-2022-jp escape sequence 1B 24 42 which is defined here as the escape sequence for the charset JIS X 0208-1983, as part of is-2022-jp-2.

I have tried using is-2022-jp-2 as the charset, but this not supported by Java 1.5.

I supposed I could manually parse the escape sequences and try a different charset.