claudiu teodorescu

Yeap... I could connect by forwarding the port on my router.... but when I try from a friend... (with no router) I cannot connect to him (he would be the server who initiates the connection). Don't know why... try tell your friend so close all the firewalls and try again...

11 years ago

Java Media Framework - How to capture screen activity?

Finally I could recod the video and the sound. The file was 0 bytes length cause I didn't close the processor and datasink because my WindowClose event was not working properly.
Note: I use LiveStream and DataSource classes from ScreenGrabber example from Sun AND I renamed DataSource to CDataSource (because it was confusing for netbeans IDE) + I passed the MediaLocator in the constructor of CDataSource class so, in that class you must modify this:

This is the main class (don't forget to select the right recording device of your soundcard). I post it for everyone trying to do this

Enjoy my code

// first don't forget to add a new JFrame (visually)
import java.awt.event.WindowAdapter;
import java.awt.event.WindowEvent;
import java.io.IOException;
import java.util.logging.Level;
import java.util.logging.Logger;
import javax.media.CannotRealizeException;
import javax.media.CaptureDeviceInfo;
import javax.media.CaptureDeviceManager;
import javax.media.IncompatibleSourceException;
import javax.media.NoDataSourceException;
import javax.media.NoPlayerException;
import javax.media.Processor;
import javax.media.DataSink;
import javax.media.Format;
import javax.media.Manager;
import javax.media.MediaLocator;
import javax.media.NotRealizedError;
import javax.media.ProcessorModel;
import javax.media.datasink.DataSinkEvent;
import javax.media.datasink.DataSinkListener;
import javax.media.format.AudioFormat;
import javax.media.format.VideoFormat;
import javax.media.protocol.DataSource;
import javax.media.protocol.FileTypeDescriptor;
import javax.media.protocol.PushBufferDataSource;
/*
* To change this template, choose Tools | Templates
* and open the template in the editor.
*/
/*
* capture.java
*
* Created on Dec 2, 2009, 4:01:32 PM
*/
/**
*
* @author Claudiu
*/
public class capture extends javax.swing.JFrame implements DataSinkListener{
private DataSink dataSink;
private Processor outputProcessor;
CaptureDeviceInfo cdi;
public capture() throws IOException, NoDataSourceException, NoPlayerException, CannotRealizeException, IncompatibleSourceException {
initComponents();
// video DataSource
MediaLocator sourceLocator = new MediaLocator("screen://0,0,800,600/5");
/*
* javax.media.NoDataSourceException: Cannot find a DataSource for: screen://352,264,320,240/5
at javax.media.Manager.createDataSource(Manager.java:1037)
at commented line bellow*/
// CDataSource videoDS = (CDataSource) Manager.createDataSource(sourceLocator);
CDataSource videoDS = new CDataSource(sourceLocator);
// sound DataSource
// cdi = CaptureDeviceManager.getDevice("DirectSoundCapture");
// MediaLocator soundMediaLocator = cdi.getLocator();
MediaLocator soundMediaLocator = new MediaLocator("javasound://0");
DataSource soundDS = Manager.createDataSource(soundMediaLocator);
videoDS.connect();
soundDS.connect();
//merge Data Sources - is it correct?
DataSource ds = Manager.createMergingDataSource(new DataSource[]{videoDS, soundDS});
System.out.println("DataSource type = " + ds.getContentType() + "\n" +
"videoDS = "+((PushBufferDataSource) ds).getStreams()[0].getFormat() + "\n" +
"audioDS = "+((PushBufferDataSource) ds).getStreams()[1].getFormat());
//save to video file
saveFile(ds);
//handler
}
private void saveFile(DataSource ds) throws NotRealizedError {
ProcessorModel outputPM = new ProcessorModel(ds,
new Format[]{new VideoFormat(VideoFormat.CINEPAK),new AudioFormat(AudioFormat.LINEAR)},
new FileTypeDescriptor(FileTypeDescriptor.MSVIDEO)
);
//save file here
MediaLocator dest = new MediaLocator("file://D:/rec.avi");
try {
outputProcessor = Manager.createRealizedProcessor(outputPM);
DataSource newDS = outputProcessor.getDataOutput();
/* newDS.connect();
newDS.start();*/
dataSink = Manager.createDataSink(newDS, dest);
dataSink.open();
dataSink.start();
dataSink.addDataSinkListener(this);
//record to that file
outputProcessor.start();
} catch(Exception e) {
e.printStackTrace();
}
}
/** This method is called from within the constructor to
* initialize the form.
* WARNING: Do NOT modify this code. The content of this method is
* always regenerated by the Form Editor.
*/
@SuppressWarnings("unchecked")
// <editor-fold defaultstate="collapsed" desc="Generated Code">
private void initComponents() {
setDefaultCloseOperation(javax.swing.WindowConstants.EXIT_ON_CLOSE);
setTitle("Capture");
addWindowListener(new java.awt.event.WindowAdapter() {
public void windowClosing(java.awt.event.WindowEvent evt) {
formWindowClosing(evt);
}
});
javax.swing.GroupLayout layout = new javax.swing.GroupLayout(getContentPane());
getContentPane().setLayout(layout);
layout.setHorizontalGroup(
layout.createParallelGroup(javax.swing.GroupLayout.Alignment.LEADING)
.addGap(0, 400, Short.MAX_VALUE)
);
layout.setVerticalGroup(
layout.createParallelGroup(javax.swing.GroupLayout.Alignment.LEADING)
.addGap(0, 300, Short.MAX_VALUE)
);
pack();
}// </editor-fold>
private void formWindowClosing(java.awt.event.WindowEvent evt) {
// TODO add your handling code here:
if(outputProcessor != null) {
outputProcessor.close();
System.out.println("processor closed");
if(dataSink != null) {
try {
dataSink.stop();
dataSink.close();
} catch (IOException ex) {
Logger.getLogger(capture.class.getName()).log(Level.SEVERE, null, ex);
}
}
System.out.println("processor stoped and closed");
}
}
/**
* @param args the command line arguments
*/
public static void main(String args[]) {
java.awt.EventQueue.invokeLater(new Runnable() {
public void run() {
try {
new capture().setVisible(true);
} catch (IOException ex) {
Logger.getLogger(capture.class.getName()).log(Level.SEVERE, null, ex);
} catch (NoDataSourceException ex) {
Logger.getLogger(capture.class.getName()).log(Level.SEVERE, null, ex);
} catch (NoPlayerException ex) {
Logger.getLogger(capture.class.getName()).log(Level.SEVERE, null, ex);
} catch (CannotRealizeException ex) {
Logger.getLogger(capture.class.getName()).log(Level.SEVERE, null, ex);
} catch (IncompatibleSourceException ex) {
Logger.getLogger(capture.class.getName()).log(Level.SEVERE, null, ex);
}
}
});
}
public void dataSinkUpdate(DataSinkEvent dse) {
System.out.println("dse: " + dse);
}
// Variables declaration - do not modify
// End of variables declaration
}

11 years ago

Java Media Framework - How to capture screen activity?

Well... I try make it work but looks like the file is 0 bytes lenght.... something is wrong with recording...

11 years ago

Java Media Framework - How to capture screen activity?

I already used screenshots with Robot and send them as byte arrays using sockets but the framerate is to little, so I wanted to capture my screen as video file and stream it to the client using HTTP... first I want to record the screen to a video file. I tried this but the video file is 0 bytes... Don't know why. Hre is the code: I used DataSource and LiveStream example classes (LiveStream feeds the DataSource with screenshots using a Robot). I renamed DataSource to CDataSource and passed the MediaLocator to is

public class capture extends javax.swing.JFrame implements DataSinkListener{
private DataSink dataSink;
private Processor outputProcessor;
CaptureDeviceInfo cdi;
public capture() throws IOException, NoDataSourceException, NoPlayerException, CannotRealizeException, IncompatibleSourceException {
initComponents();
// video DataSource
MediaLocator sourceLocator = new MediaLocator("screen://352,264,320,240/5");
/*
* javax.media.NoDataSourceException: Cannot find a DataSource for: screen://352,264,320,240/5
at javax.media.Manager.createDataSource(Manager.java:1037)
at commented line bellow*/
// CDataSource videoDS = (CDataSource) Manager.createDataSource(sourceLocator);
CDataSource videoDS = new CDataSource(sourceLocator);
// sound DataSource
cdi = CaptureDeviceManager.getDevice("DirectSoundCapture");
MediaLocator soundMediaLocator = cdi.getLocator();
DataSource soundDS = Manager.createDataSource(soundMediaLocator);
videoDS.connect();
soundDS.connect();
//merge Data Sources - is it correct?
DataSource ds = Manager.createMergingDataSource(new DataSource[]{videoDS, soundDS});
System.out.println("DataSource type = " + ds.getContentType() + "\n" +
"videoDS = "+((PushBufferDataSource) ds).getStreams()[0].getFormat() + "\n" +
"audioDS = "+((PushBufferDataSource) ds).getStreams()[1].getFormat());
/* the result for the line above is:
DataSource type = raw
videoDS = RGB, 320x240, FrameRate=5.0, Length=230400, 32-bit, Masks=16711680:65280:255, LineStride=320, class [I
audioDS = LINEAR, 44100.0 Hz, 16-bit, Stereo, LittleEndian, Signed
*/
//save to video file
saveFile(ds);
//handler
addWindowListener(new WindowAdapter() {
@Override
public void windowClosed(WindowEvent e) {
try {
if(outputProcessor != null) {
outputProcessor.close();
}
if(dataSink != null) {
dataSink.close();
dataSink.stop();
}
} catch(IOException ex) {
ex.printStackTrace();
}
}
});
}
private void saveFile(DataSource ds) throws NotRealizedError {
ProcessorModel outputPM = new ProcessorModel(ds,
new Format[]{new VideoFormat(VideoFormat.JPEG),new AudioFormat(AudioFormat.LINEAR)},
new FileTypeDescriptor(FileTypeDescriptor.QUICKTIME)
);
//save file here
MediaLocator dest = new MediaLocator("file://D:/rec.mov");
try {
outputProcessor = Manager.createRealizedProcessor(outputPM);
DataSource newDS = outputProcessor.getDataOutput();
newDS.connect();
newDS.start();
dataSink = Manager.createDataSink(newDS, dest);
dataSink.open();
dataSink.start();
dataSink.addDataSinkListener(this);
//record to that file
outputProcessor.start();
} catch(Exception e) {
e.printStackTrace();
}
}
public void dataSinkUpdate(DataSinkEvent dse) {
System.out.println("dse: " + dse);// I can never see this message
}
}

Why is that file 0 bytes? something wrong with datasink?

11 years ago

Java Media Framework - How to capture screen activity?

Hello,
I have to capture video desktop activity (including audio) to a file using JMF. I spent hours and hours searching this... a have studied a lot of classes, examples BUT I don't know how to bind them... how to record the actvity. My project is to record screen activity, upload on a server and finally control my computer remotely from an applet (or from another java desktop application).

Can someone show me some hints or code for modifying JVidCap example from Sun? Someone else on Sun forum said he could do it but did not say how...

I just want to modify the video capturing so that I get the screen actifity recorded. I read nearly all examples possible including Screen Grabber...

Please help me!

This is the capturing class in the example:

import java.io.IOException;
import javax.media.*;
import javax.media.protocol.*;
import javax.media.format.*;
import javax.media.control.*;
import java.util.Vector;
import java.awt.*;
import com.sun.media.ui.PlayerWindow;
public class CaptureUtil {
public static DataSource getCaptureDS(VideoFormat vf, AudioFormat af) throws IOException, NoDataSourceException {
DataSource dsVideo = null; // this would be the video datasource...
DataSource dsAudio = null;
DataSource ds = null;
// Create a capture DataSource for the video
// If there is no video capture device, then exit with null
if (vf != null) {
dsVideo = createDataSource(vf);
if (dsVideo == null)
return null;
}
if (af != null) {
dsAudio = createDataSource(af);
}
// Create the monitoring datasource wrapper
if (dsVideo != null) {
dsVideo = new MonitorCDS(dsVideo);
if (dsAudio == null)
return dsVideo;
ds = dsVideo;
} else if (dsAudio != null) {
return dsAudio;
} else
return null;
// Merge the data sources, if both audio and video are available
try {
MediaLocator medialocator = new MediaLocator("");
DataSource datasource1 = Manager.createDataSource(medialocator);
ds = Manager.createMergingDataSource(new DataSource [] {
dsAudio, dsVideo
});
} catch (IncompatibleSourceException ise) {
return null;
}
return ds;
}
static DataSource createDataSource(Format format) {
DataSource ds;
Vector devices;
CaptureDeviceInfo cdi;
MediaLocator ml;
// Find devices for format
devices = CaptureDeviceManager.getDeviceList(format);
if (devices.size() < 1) {
System.err.println("! No Devices for " + format);
return null;
}
// Pick the first device
cdi = (CaptureDeviceInfo) devices.elementAt(0);
ml = cdi.getLocator();
try {
ds = Manager.createDataSource(ml);
ds.connect();
if (ds instanceof CaptureDevice) {
setCaptureFormat((CaptureDevice) ds, format);
}
} catch (Exception e) {
System.err.println(e);
return null;
}
return ds;
}
static void setCaptureFormat(CaptureDevice cdev, Format format) {
FormatControl [] fcs = cdev.getFormatControls();
if (fcs.length < 1)
return;
FormatControl fc = fcs[0];
Format [] formats = fc.getSupportedFormats();
for (int i = 0; i < formats.length; i++) {
if (formats[i].matches(format)) {
format = formats[i].intersects(format);
System.out.println("Setting format " + format);
fc.setFormat(format);
break;
}
}
}
}

I also have two classes to get the screen activity as datasource... but I really don't understand how to implement them in my application because there is no method returning a datasource object...

public class DataSource extends PushBufferDataSource {
protected Object [] controls = new Object[0];
protected boolean started = false;
protected String contentType = "raw";
protected boolean connected = false;
protected Time duration = DURATION_UNBOUNDED;
protected LiveStream [] streams = null;
protected LiveStream stream = null;
public DataSource() {
}
public String getContentType() {
if (!connected){
System.err.println("Error: DataSource not connected");
return null;
}
return contentType;
}
public void connect() throws IOException {
if (connected)
return;
connected = true;
}
public void disconnect() {
try {
if (started)
stop();
} catch (IOException e) {}
connected = false;
}
public void start() throws IOException {
// we need to throw error if connect() has not been called
if (!connected)
throw new java.lang.Error("DataSource must be connected before it can be started");
if (started)
return;
started = true;
stream.start(true);
}
public void stop() throws IOException {
if ((!connected) || (!started))
return;
started = false;
stream.start(false);
}
public Object [] getControls() {
return controls;
}
public Object getControl(String controlType) {
return null;
}
public Time getDuration() {
return duration;
}
public PushBufferStream [] getStreams() {
if (streams == null) {
streams = new LiveStream[1];
stream = streams[0] = new LiveStream(getLocator());
}
return streams;
}
}

This captures the frames using a Robot and feeds them to DataSource class:

import java.awt.*;
import java.awt.image.BufferedImage;
import javax.media.*;
import javax.media.format.*;
import javax.media.protocol.*;
import java.io.IOException;
import java.util.StringTokenizer;
public class LiveStream implements PushBufferStream, Runnable {
protected ContentDescriptor cd = new ContentDescriptor(ContentDescriptor.RAW);
protected int maxDataLength;
protected int [] data;
protected Dimension size;
protected RGBFormat rgbFormat;
protected boolean started;
protected Thread thread;
protected float frameRate = 1f;
protected BufferTransferHandler transferHandler;
protected Control [] controls = new Control[0];
protected int x, y, width, height;
protected Robot robot = null;
public LiveStream(MediaLocator locator) {
try {
parseLocator(locator);
} catch (Exception e) {
System.err.println(e);
}
//size = Toolkit.getDefaultToolkit().getScreenSize();
size = new Dimension(width, height);
try {
robot = new Robot();
} catch (AWTException awe) {
throw new RuntimeException("");
}
maxDataLength = size.width * size.height * 3;
rgbFormat = new RGBFormat(size, maxDataLength,
Format.intArray,
frameRate,
32,
0xFF0000, 0xFF00, 0xFF,
1, size.width,
VideoFormat.FALSE,
Format.NOT_SPECIFIED);
// generate the data
data = new int[maxDataLength];
thread = new Thread(this, "Screen Grabber");
}
protected void parseLocator(MediaLocator locator) {
// this parses the locator. e.g.: screen://x,y,width,height/fps
String rem = locator.getRemainder();
// Strip off starting slashes
while (rem.startsWith("/") && rem.length() > 1)
rem = rem.substring(1);
StringTokenizer st = new StringTokenizer(rem, "/");
if (st.hasMoreTokens()) {
// Parse the position
String position = st.nextToken();
StringTokenizer nums = new StringTokenizer(position, ",");
String stX = nums.nextToken();
String stY = nums.nextToken();
String stW = nums.nextToken();
String stH = nums.nextToken();
x = Integer.parseInt(stX);
y = Integer.parseInt(stY);
width = Integer.parseInt(stW);
height = Integer.parseInt(stH);
}
if (st.hasMoreTokens()) {
// Parse the frame rate
String stFPS = st.nextToken();
frameRate = (Double.valueOf(stFPS)).floatValue();
}
}
/***************************************************************************
* SourceStream
***************************************************************************/
public ContentDescriptor getContentDescriptor() {
return cd;
}
public long getContentLength() {
return LENGTH_UNKNOWN;
}
public boolean endOfStream() {
return false;
}
/***************************************************************************
* PushBufferStream
***************************************************************************/
int seqNo = 0;
public Format getFormat() {
return rgbFormat;
}
public void read(Buffer buffer) throws IOException {
synchronized (this) {
Object outdata = buffer.getData();
if (outdata == null || !(outdata.getClass() == Format.intArray) ||
((int[])outdata).length < maxDataLength) {
outdata = new int[maxDataLength];
buffer.setData(outdata);
}
buffer.setFormat( rgbFormat );
buffer.setTimeStamp( (long) (seqNo * (1000 / frameRate) * 1000000) );
BufferedImage bi = robot.createScreenCapture(new Rectangle(x, y, width, height));
bi.getRGB(0, 0, width, height,
(int[])outdata, 0, width);
buffer.setSequenceNumber( seqNo );
buffer.setLength(maxDataLength);
buffer.setFlags(Buffer.FLAG_KEY_FRAME);
buffer.setHeader( null );
seqNo++;
}
}
public void setTransferHandler(BufferTransferHandler transferHandler) {
synchronized (this) {
this.transferHandler = transferHandler;
notifyAll();
}
}
void start(boolean started) {
synchronized ( this ) {
this.started = started;
if (started && !thread.isAlive()) {
thread = new Thread(this);
thread.start();
}
notifyAll();
}
}
/***************************************************************************
* Runnable
***************************************************************************/
public void run() {
while (started) {
synchronized (this) {
while (transferHandler == null && started) {
try {
wait(1000);
} catch (InterruptedException ie) {
}
} // while
}
if (started && transferHandler != null) {
transferHandler.transferData(this);
try {
Thread.currentThread().sleep( 10 );
} catch (InterruptedException ise) {
}
}
} // while (started)
} // run
// Controls
public Object [] getControls() {
return controls;
}
public Object getControl(String controlType) {
try {
Class cls = Class.forName(controlType);
Object cs[] = getControls();
for (int i = 0; i < cs.length; i++) {
if (cls.isInstance(cs[i]))
return cs[i];
}
return null;
} catch (Exception e) { // no such controlType or such control
return null;
}
}
}

Sorry I posted 3 big classes but I hope someone can bind them or help me to go on on this project.... it is so important to me ...

11 years ago

I made my ip static. And tried to forward the port.. see the images... I don't know if I made it well... all I know is I cannot connect the client to server yet. It's working in LAN. Thanks for interest in helping me

11 years ago

Thanks for reply, Henry.
My computer which would run the server application is behind a router (ASUS). I don't know how to forward the port. The other computer (a friend) runs the client and I don't think he has a router... but however I will take your advices.
I must add that I tried to run the server and client both on my computer and connect the client to my public address. If the port was forwarded the connection should be entablished?
Now as you know exactly the situation can you tell me how to forward the port? And should I disable my antivirus and firewall or add the forwarded port as "trusted"?

Thanks,

Claudiu

11 years ago

Hello,
I wrote a chat application, client+server using sockets. The problem is that I have to make it comunicate over internet and it's working only over LAN. I disabled my firewall, I verified my address to be public BUT I cannot make it work over internet. What's the problem? If I connect the client to my local IP, ok. If I try to connect it to my public or someone else computer my public IP, it's not working. "Connection is refuzed"
I need this so much! Please help if you can! My application should send files over internet between the two computers. I tried all these days...

11 years ago