batuk chatuk

For 100K records or more the above code didnt work on my machine.. ( i had kept JVM Heap size to Max. 1300K.. )
The reason was the XMLConverter was not able to convert that much data into XML So i wrote the code to divide all the ArrayLists in chunks and then convert them and write them into the same file..

FileWriter fw = new FileWriter(new File("foo.xml

, true);

the flag in the constructor is for Appending the new data to same file..
and so file can be generated without any trouble..

Best Regards

17 years ago

Its Done!!!

File writing is happening totally with all data at a time in above code..
So this is the answer to better and memory friendly code...

xmlSource = xmlConverter.convert(obj);
BufferedReader bufferedReader = new BufferedReader(xmlSource.getReader());
PrintWriter pw = new PrintWriter(new BufferedWriter(new FileWriter(f)));
int count = 0;
int buffer=1024;
char[] c1=new char[buffer];
while((count = bufferedReader.read(c1, 0, buffer)) != -1){
pw.write(c1, 0, count);
}
pw.flush();
pw.close();

17 years ago

Unmarshalling the XML to create an Object of a class

to test the application we are first of all keeping a dummy XML which will have output parameters as per given input for a specific function.

Now we call that function with same input paras and then take the output object. This object is matched with the Unmarshalled Object of the dummy XML.

So this will be a testcase for our application and if Objects dont match it will return False.. This way all functions of particular class can be tested and any changes that affect the functional part will be easily detected...

Thanks.

17 years ago

thanks!!!

File f = new File("foo.xml");
PrintWriter pw = new PrintWriter(new BufferedWriter(new FileWriter(f)));
pw.write(xmlConverter.getXML(obj));

Using BW does speed up the process by almost 40%, although the PC remains in a numb state during that time..but it does work..

I m afraid this solution is not gonna be enough as there are around 100k entries on Production env at max.. ( I checked above sol. on 50000 records..)

Is there any possibility that i split the records and then in chunks i add them in "same file". (dont want to create more than 1 XML for one page..)

Thanks again...

17 years ago

I am converting an object (ArrayList) in XML and then storing that XML as a file on local machine. When there are large number of data, the XML takes too long to write in a File or doesnt write at all (gives some exception).

xmlSource = xmlConverter.convert(object); // object here is no.of ArrayLists..

FileWriter fw = new FileWriter(f);
fw.write(xmlConverter.getXML());

fw.write() takes too much time. Is there any other way which doesnt eat up so much memory ???

17 years ago

Unmarshalling the XML to create an Object of a class

I am writing JUnit testcases for my application. In the application there are complex VOs (Value objects) and TO objects which have arrayLists.Now i create an dummy XML from the dummy data, unmarshall it to create dummy object and then Compare it to the above actual object.

For comparing simple objects which have primitive types (int,String,..) i can unmarshall the dummy XML to object and compare it. (with reflection API)
Same thing i am not able to do when there are Arraylists and arraylists within arraylists in an object.. When I try to unmarshall that, i dont get the converted object in proper format.

Is there any way I can unmarshal complex objects with 3 to 4 hierarchies so I can compare them and test???

17 years ago

Unmarshalling the XML to create an Object of a class

I am writing the JUnit testcases for my application. In the application there are complex VOs (Value objects) and TO objects which have arrayLists.Now i create an dummy XML from the dummy data, unmarshall it to create dummy object and then Compare it to the above actual object.

For comparing simple objects which have primitive types i can unmarshall the dummy XML to object and compare it. (with refletion API)
Same thing i am not able to do when there are Arraylists and arraylists within arraylists in an object.. When I try to unmarshall that, i dont get the converted object in proper format.

Is there any way I can unmarshal complex objects with 3 to 4 hierarchies so I can compare them and test???

17 years ago