scripting help needed!

[Gopu Akraju]

I have not done any scrpting before. Thanks.

I am using wget to download contents as below:

wget http://server/app/browse/downloadRaw?[B]id=23456[/B]

I want to do this programatically. For example, I have a list of id in a text file as below:

list.txt

----------
23456
78910
..
..
.
.
-----------

How do I programatically open this list.txt and use wget command? Thanks.
Regards

[ UD: fixed CODE tags ]
[ July 09, 2008: Message edited by: Ulf Dittmer ]

[Andrew Monkhouse]

I strongly recommend you look at the following 2 options in wget:

       --limit-rate=amount
           Limit the download speed to amount bytes per second.  Amount may
           be expressed in bytes, kilobytes with the k suffix, or megabytes
           with the m suffix.  For example, --limit-rate=20k will limit the
           retrieval rate to 20KB/s.  This is useful when, for whatever rea‐
           son, you don�t want Wget to consume the entire available band‐
           width.
 
           This option allows the use of decimal numbers, usually in conjunc‐
           tion with power suffixes; for example, --limit-rate=2.5k is a
           legal value.
 
           Note that Wget implements the limiting by sleeping the appropriate
           amount of time after a network read that took less time than spec‐
           ified by the rate.  Eventually this strategy causes the TCP trans‐
           fer to slow down to approximately the specified rate.  However, it
           may take some time for this balance to be achieved, so don�t be
           surprised if limiting the rate doesn�t work well with very small
           files.
 
       -w seconds
       --wait=seconds
           Wait the specified number of seconds between the retrievals.  Use
           of this option is recommended, as it lightens the server load by
           making the requests less frequent.  Instead of in seconds, the
           time can be specified in minutes using the "m" suffix, in hours
           using "h" suffix, or in days using "d" suffix.
 
           Specifying a large value for this option is useful if the network
           or the destination host is down, so that Wget can wait long enough
           to reasonably expect the network error to be fixed before the
           retry.  The waiting interval specified by this function is influ‐
           enced by "--random-wait", which see.

Using these is much more friendly than just hammering the server as you try to download 'x' number of files.

As for your actual question - you might want to consider concatenating the file to standard out, piping that through the shell's read command to store it in a variable, then using that. Viz:

cat list.txt | while read LINE;do
  echo "found ID ${LINE}"
done

Can you see how to use this in your case?

Regards, Andrew