JavaFX vs H.264 on Linux

[Ricardo Capp]

Hello all,

I've been looking on the Internet for something that could point me to a solution for this small problem. But found nothing so far. I can play H.264 files without any problems on my external player. But inside JavaFX I get the error for a format not supported:

(<unknown>:11149): GStreamer-CRITICAL **: gst_pad_alloc_buffer_full: assertion `size >= 0' failed
FX Media Object caught Exception com.sun.media.jmc.MediaUnsupportedException: Unsupported media: file:///home/ricardo/Videos/charme_chulo-nova_onda_caipira.flv
    source ='file:///home/ricardo/Videos/charme_chulo-nova_onda_caipira.flv'
com.sun.media.jmc.MediaUnsupportedException: Unsupported media: file:///home/ricardo/Videos/charme_chulo-nova_onda_caipira.flv
        at com.sun.media.jmcimpl.PeerManager$1.run(PeerManager.java:59)
        at java.security.AccessController.doPrivileged(Native Method)
        at com.sun.media.jmcimpl.PeerManager.throwMediaException(PeerManager.java:52)
        at com.sun.media.jmcimpl.PeerManager.getMediaPeer(PeerManager.java:216)
        at com.sun.media.jmc.Media.<init>(Media.java:66)
        at javafx.scene.media.Media.onReplace$source(Media.fx:90)
        at javafx.scene.media.Media.set$source(Media.fx)
        at desktopapplicationfx.Main$1Local$1.doit$$0(Main.fx:57)
        at desktopapplicationfx.Main$1Local$1.doit$$0(Main.fx:57)
        at desktopapplicationfx.Main.javafx$run$(Main.fx:40)
        at desktopapplicationfx.Main.javafx$run$(Main.fx:40)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at com.sun.javafx.runtime.provider.GUIRuntimeProvider$1.run(GUIRuntimeProvider.java:73)
        at com.sun.javafx.tk.swing.SwingToolkit$StartupRoutine.run(SwingToolkit.fx:873)
        at java.awt.event.InvocationEvent.dispatch(InvocationEvent.java:209)
        at java.awt.EventQueue.dispatchEvent(EventQueue.java:597)
        at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:269)
        at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:184)
        at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:174)
        at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:169)
        at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:161)
        at java.awt.EventDispatchThread.run(EventDispatchThread.java:122)

I believe it can find my Gstreamer library because of the first message appearing to be an warning from GStreamer itself. But I may be wrong. How do I know if JavaFX is really finding and using my Gstreamer library?


This is my small code:

import javafx.scene.Scene;
import javafx.scene.media.MediaView;
import javafx.scene.media.MediaPlayer;
import javafx.scene.media.Media;


public class Main {

    // <editor-fold defaultstate="collapsed" desc="Generated Code">
    public-read def scene: javafx.scene.Scene = javafx.scene.Scene {
        width: 480.0
        height: 320.0
        content: getDesignRootNodes ()
    }
    
    public-read def currentState: org.netbeans.javafx.design.DesignState = org.netbeans.javafx.design.DesignState {
    }
    
    public function getDesignRootNodes (): javafx.scene.Node[] {
        [ ]
    }
    
    public function getDesignScene (): javafx.scene.Scene {
        scene
    }
    // </editor-fold>

}

function run (): Void {
    var design = Main {};

    javafx.stage.Stage {

        var theScene: Scene;
        title: "Main"


        scene: theScene = Scene{
            width: 640
            height: 352
            content: MediaView{
                fitWidth: bind theScene.width
                fitHeight: bind theScene.height
                mediaPlayer: MediaPlayer{
                    autoPlay:true
                    media: Media{
                        //h264 video. not playing. format not supported. can play on my external player. 
                        source: "file:///home/ricardo/Videos/charme_chulo-nova_onda_caipira.flv"
                        // can play. 
                        //source: "http://projavafx.com/movies/elephants-dream-640x352.flv"
                    }

                }

            }

        }

    }
}

Thank you in advance.

[Rob Spoor]

Welcome to the Ranch!

I think you're right in your conclusion that GStreamer is found properly. It seems like it's throwing the actual error, which is then converted into a Java Exception.
You are able to play a different file. Can you also:
1) play that different file after downloading it and using file:// to reference it?
2) play the problematic file after uploading it to a web server and using http:// to reference it?

[Ricardo Capp]

Rob Prime wrote:Welcome to the Ranch!

I think you're right in your conclusion that GStreamer is found properly. It seems like it's throwing the actual error, which is then converted into a Java Exception.
You are able to play a different file. Can you also:
1) play that different file after downloading it and using file:// to reference it?

Yes. I can play elephants-dream-640x352.flv using file:// . According to mplayer, this is an VP6 with mp3.

2) play the problematic file after uploading it to a web server and using http:// to reference it?

Using another h.264 video leads to the same problem, with both file:// and http:// :

// source: "file:///home/ricardo/Videos/dcc119_aula7.flv"
source: "http://www.despertrh.com.br/imagens/dcc119_aula7.flv"

I tried another container (an avi file. haven't tried ogg) and it can't play it too. As far as I know, JavaFX can only deal with FLV containers, but with your system plugins it can deal with other formats. Correct me if I'm wrong.


Thank you in advance!

[Ricardo Capp]

Updating:


We´ve gave up on using JavaFX (deadline was really near) and used an mplayer controller instead. We´ve come to this approach a couple of weeks ago. As soon as possible, I will see if I can post our code or at least how to get trough it.


Cheers and thank you!

[Alexandre Eiras]

Hi Ricardo,

You can post your example with mplayer? I want to use JavaFX, but I have the same problem.

Thank you

[Ricardo Capp]

Alexandre Eiras wrote:Hi Ricardo,

You can post your example with mplayer? I want to use JavaFX, but I have the same problem.

Thank you

Hi there, Alexandre. I hope this is still useful for you.

In this example I created a Swing project in Netbeans and used a form to build the interface. This example is really simple and has 3 main files - Player.java, OpenFile.java and the Cointaner.java (for the form)


Here, we will be able only to open the file, not to read any particular information about the media file.

 
package controller;

import java.awt.Canvas;
import java.io.BufferedReader;
import java.io.BufferedWriter;
import java.io.IOException;
import java.io.OutputStreamWriter;
import javax.swing.JOptionPane;

public class Player {

    private Canvas videoContainer = null; 
    private Process process = null;
    private String osName;
    private BufferedWriter bufferedWriter;
    private BufferedReader input;

    public Player(String url, Canvas Container) {
        this.videoContainer = Container;
        String str;
        String line;

        // identifying the OS
        osName = System.getProperty("os.name");

        //we will kill the process if it exist. 
        if (process != null) {
            try {
                process.destroy();
            } catch (Exception ev) {
                JOptionPane.showMessageDialog(null, "error! " + ev.getMessage());
            }
        }

        try {
            long winid = 0;
            String command = "";
            if (osName.startsWith("Windows")) {
                final Class<?> cl = Class.forName("sun.awt.windows.WComponentPeer");
                java.lang.reflect.Field reflectedField = cl.getDeclaredField("hwnd");
                reflectedField.setAccessible(true);
                winid = reflectedField.getLong(videoContainer.getPeer());
                command = "mplayer.exe -vo gl2 -quiet -slave -subfont-text-scale 3 -subfont-osd-scale 3 -slave -colorkey 0x00000  " + "\"" + url + "\"";

            }

            if (osName.startsWith("Linux")) {
                final Class<?> cl = Class.forName("sun.awt.X11ComponentPeer");
                java.lang.reflect.Method m = cl.getMethod("getContentWindow");
                Object obj = m.invoke(videoContainer.getPeer());
                winid = Long.parseLong(obj.toString());
                command = "mplayer  -slave -quiet  " + url;

            }


            process = Runtime.getRuntime().exec(command + " -wid " + winid);
            bufferedWriter = new BufferedWriter(new OutputStreamWriter(getProcess().getOutputStream()));

            bufferedWriter.write("get_video_codec ");
            bufferedWriter.newLine();
            bufferedWriter.flush();
            bufferedWriter.write("get_video_bitrate ");
            bufferedWriter.newLine();
            bufferedWriter.flush();
            bufferedWriter.write("get_audio_bitrate ");
            bufferedWriter.newLine();
            bufferedWriter.flush();
            bufferedWriter.write("get_audio_samples ");
            bufferedWriter.newLine();
            bufferedWriter.flush();
            bufferedWriter.write("get_audio_codec ");
            bufferedWriter.newLine();
            bufferedWriter.write("get_time_length ");
            bufferedWriter.newLine();
            bufferedWriter.flush();

            bufferedWriter.write("osd 4");
            bufferedWriter.newLine();
            bufferedWriter.flush();

            bufferedWriter.write("get_time_length ");
            bufferedWriter.newLine();
            bufferedWriter.flush();

        } catch (Exception ex) {
            JOptionPane.showMessageDialog(null, "Errro1: " + ex.getMessage());
            return;
        }

    }

    public void execCommand(String command) {
        try {
            bufferedWriter.write(command);
            bufferedWriter.newLine();
            bufferedWriter.flush();
        } catch (IOException ex) {
            JOptionPane.showMessageDialog(null, "error when executing command" + ex.getMessage());
        }
    }

    /**
     * @return the process
     */
    public Process getProcess() {
        return process;
    }

    /**
     * @param process the process to set
     */
    public void setProcess(Process process) {
        this.process = process;
    }
}

Then, we need the file chooser/"opener" for this basic player:

package controller;

import javax.swing.JFileChooser;
import javax.swing.JOptionPane;
import javax.swing.filechooser.FileNameExtensionFilter;

public class OpenFile {
    private String nameFile = null;

    public OpenFile() {
        final JFileChooser chooser = new JFileChooser();
        //here we can set what kinds of file we will be allowed to open or want to be shown on our file list
        chooser.setFileFilter(new FileNameExtensionFilter("all media files", "flv","mpeg","mpg","mov","wmv"));
        //We can deny the all file filter
        chooser.setAcceptAllFileFilterUsed(false);

        if (chooser.showOpenDialog(null) == JFileChooser.APPROVE_OPTION) {

            nameFile = chooser.getSelectedFile().toString();

        }
    }

    public String getNameFile() {
        return nameFile;
    }
}

At last, the Container. I'm ommiting the Conatiner.form.

package view;

import controller.OpenFile;
import controller.Player;

public class Container extends javax.swing.JFrame {

    boolean isplay = false;

    /** Creates new form Container */
    public Container() {
        initComponents();
    }

    /** This method is called from within the constructor to
     * initialize the form.
     * WARNING: Do NOT modify this code. The content of this method is
     * always regenerated by the Form Editor.
     */
    @SuppressWarnings("unchecked")
    // <editor-fold defaultstate="collapsed" desc="Generated Code">//GEN-BEGIN:initComponents
    private void initComponents() {

        videoCOntainer = new java.awt.Canvas();
        jPanel1 = new javax.swing.JPanel();
        btnStop = new javax.swing.JButton();
        btnPlay = new javax.swing.JButton();
        cbOsd = new javax.swing.JCheckBox();
        jMenu = new javax.swing.JMenuBar();
        jMenuFile = new javax.swing.JMenu();
        jMenuItemOpen = new javax.swing.JMenuItem();
        jMenu2 = new javax.swing.JMenu();

        setDefaultCloseOperation(javax.swing.WindowConstants.EXIT_ON_CLOSE);

        videoCOntainer.setBackground(java.awt.Color.black);

        btnStop.setFont(new java.awt.Font("DejaVu Sans", 0, 3));
        btnStop.setIcon(new javax.swing.ImageIcon(getClass().getResource("/img/Stop.png"))); // NOI18N
        btnStop.setAlignmentY(0.0F);
        btnStop.setBorder(null);
        btnStop.setHorizontalTextPosition(javax.swing.SwingConstants.CENTER);

        btnPlay.setIcon(new javax.swing.ImageIcon(getClass().getResource("/img/Play.png"))); // NOI18N
        btnPlay.setBorder(null);
        btnPlay.addActionListener(new java.awt.event.ActionListener() {
            public void actionPerformed(java.awt.event.ActionEvent evt) {
                btnPlayActionPerformed(evt);
            }
        });

        javax.swing.GroupLayout jPanel1Layout = new javax.swing.GroupLayout(jPanel1);
        jPanel1.setLayout(jPanel1Layout);
        jPanel1Layout.setHorizontalGroup(
            jPanel1Layout.createParallelGroup(javax.swing.GroupLayout.Alignment.LEADING)
            .addGroup(jPanel1Layout.createSequentialGroup()
                .addComponent(btnStop)
                .addPreferredGap(javax.swing.LayoutStyle.ComponentPlacement.RELATED)
                .addComponent(btnPlay)
                .addContainerGap(javax.swing.GroupLayout.DEFAULT_SIZE, Short.MAX_VALUE))
        );
        jPanel1Layout.setVerticalGroup(
            jPanel1Layout.createParallelGroup(javax.swing.GroupLayout.Alignment.LEADING)
            .addGroup(jPanel1Layout.createSequentialGroup()
                .addGroup(jPanel1Layout.createParallelGroup(javax.swing.GroupLayout.Alignment.BASELINE)
                    .addComponent(btnStop)
                    .addComponent(btnPlay))
                .addContainerGap(javax.swing.GroupLayout.DEFAULT_SIZE, Short.MAX_VALUE))
        );

        cbOsd.setSelected(true);
        cbOsd.setText("OSD");
        cbOsd.addActionListener(new java.awt.event.ActionListener() {
            public void actionPerformed(java.awt.event.ActionEvent evt) {
                cbOsdActionPerformed(evt);
            }
        });

        jMenuFile.setText("File");

        jMenuItemOpen.setText("open media file");
        jMenuItemOpen.addActionListener(new java.awt.event.ActionListener() {
            public void actionPerformed(java.awt.event.ActionEvent evt) {
                jMenuItemOpenActionPerformed(evt);
            }
        });
        jMenuFile.add(jMenuItemOpen);

        jMenu.add(jMenuFile);

        jMenu2.setText("Edit");
        jMenu.add(jMenu2);

        setJMenuBar(jMenu);

        javax.swing.GroupLayout layout = new javax.swing.GroupLayout(getContentPane());
        getContentPane().setLayout(layout);
        layout.setHorizontalGroup(
            layout.createParallelGroup(javax.swing.GroupLayout.Alignment.LEADING)
            .addGroup(layout.createSequentialGroup()
                .addContainerGap()
                .addGroup(layout.createParallelGroup(javax.swing.GroupLayout.Alignment.LEADING)
                    .addGroup(javax.swing.GroupLayout.Alignment.TRAILING, layout.createSequentialGroup()
                        .addComponent(videoCOntainer, javax.swing.GroupLayout.DEFAULT_SIZE, 476, Short.MAX_VALUE)
                        .addContainerGap())
                    .addGroup(layout.createSequentialGroup()
                        .addComponent(jPanel1, javax.swing.GroupLayout.DEFAULT_SIZE, javax.swing.GroupLayout.DEFAULT_SIZE, Short.MAX_VALUE)
                        .addGap(436, 436, 436))
                    .addGroup(layout.createSequentialGroup()
                        .addComponent(cbOsd)
                        .addContainerGap(433, Short.MAX_VALUE))))
        );
        layout.setVerticalGroup(
            layout.createParallelGroup(javax.swing.GroupLayout.Alignment.LEADING)
            .addGroup(layout.createSequentialGroup()
                .addContainerGap()
                .addComponent(videoCOntainer, javax.swing.GroupLayout.DEFAULT_SIZE, 272, Short.MAX_VALUE)
                .addPreferredGap(javax.swing.LayoutStyle.ComponentPlacement.RELATED)
                .addComponent(jPanel1, javax.swing.GroupLayout.PREFERRED_SIZE, javax.swing.GroupLayout.DEFAULT_SIZE, javax.swing.GroupLayout.PREFERRED_SIZE)
                .addPreferredGap(javax.swing.LayoutStyle.ComponentPlacement.RELATED)
                .addComponent(cbOsd)
                .addGap(56, 56, 56))
        );

        pack();
    }// </editor-fold>//GEN-END:initComponents

    private void jMenuItemOpenActionPerformed(java.awt.event.ActionEvent evt) {//GEN-FIRST:event_jMenuItemOpenActionPerformed
        OpenFile fileVideo = new OpenFile();
        player = new Player(fileVideo.getNomeArq(), videoCOntainer);
    }//GEN-LAST:event_jMenuItemOpenActionPerformed

    private void btnPlayActionPerformed(java.awt.event.ActionEvent evt) {//GEN-FIRST:event_btnPlayActionPerformed
        // TODO add your handling code here:
        if (player.getProcess() != null) {
            player.execCommand("pause ");
            if (isplay) {
                btnPlay.setIcon(new javax.swing.ImageIcon(getClass().getResource("/imagens/Play.png")));
                isplay = false;
            } else {
                btnPlay.setIcon(new javax.swing.ImageIcon(getClass().getResource("/imagens/Pause.png")));
                isplay = true;
            }
        }
    }//GEN-LAST:event_btnPlayActionPerformed

    private void cbOsdActionPerformed(java.awt.event.ActionEvent evt) {//GEN-FIRST:event_cbOsdActionPerformed
        if (cbOsd.isSelected()) {
            player.execCommand("osd 4");

        } else {
            player.execCommand("osd 0");
        }
    }//GEN-LAST:event_cbOsdActionPerformed

    /**
     * @param args the command line arguments
     */
    public static void main(String args[]) {
        java.awt.EventQueue.invokeLater(new Runnable() {

            public void run() {
                new Container().setVisible(true);
            }
        });
    }
    // Variables declaration - do not modify//GEN-BEGIN:variables
    private javax.swing.JButton btnPlay;
    private javax.swing.JButton btnStop;
    private javax.swing.JCheckBox cbOsd;
    private javax.swing.JMenuBar jMenu;
    private javax.swing.JMenu jMenu2;
    private javax.swing.JMenu jMenuFile;
    private javax.swing.JMenuItem jMenuItemOpen;
    private javax.swing.JPanel jPanel1;
    private java.awt.Canvas videoCOntainer;
    // End of variables declaration//GEN-END:variables
    Player player = null;
}

And if you wish to catch media information, such as duration, you have use something like this:

input = new BufferedReader(new InputStreamReader(process.getInputStream()));


 bufferedWriter.write("get_time_length ");
            bufferedWriter.newLine();
            bufferedWriter.flush();
            duracaoVideo = input.readLine().split("=")[1];

One thing we found a little hard to implement was the progress bar. For that, we had to create a Listener. If you have some trouble creating it, I can try to help you. I hope this will help you, and I'm sorry for taking too long to answer your post.

Take care,
Ricardo