LinHES Forums
http://forum.linhes.org/

Job Queueing
http://forum.linhes.org/viewtopic.php?f=11&t=11956
Page 1 of 1

Author:  baishen78 [ Mon Oct 02, 2006 12:36 pm ]
Post subject:  Job Queueing

I'd like to finetune my job queueing. I know that I can specify the number of jobs run at once, and when the jobs are run, but I'd like to specify different parameters for different jobs.

For example, commercial flagging only uses about 15% of my cpu. So I'd like to run 2-3 of them at once, and allow them to run at any time.

However, transcoding takes up the entire cpu, so I only want to run one transcoding job at a time, and no other jobs while it's running. And since my myth box gets a little laggy while the transcoding job is running, I'd like to limit it's run time to when I'm asleep or at work.

Can this be done?

Author:  turpie [ Mon Oct 02, 2006 5:53 pm ]
Post subject: 

Why doesn't comm flagging use any more CPU time than 15%?

If it is currently limited by hard disk bandwidth then running more than one isn't going to go any quicker. You'd just have two processes using 7% CPU each.

Or is this for Live TV?

Author:  baishen78 [ Tue Oct 03, 2006 8:20 am ]
Post subject: 

I have no idea why commflag is only using 15%. And no, this isn't live tv. I don't watch live tv at all anymore.

Is there a way to check if my bottleneck is the hard drive?

Author:  mogwa_ [ Thu Nov 02, 2006 7:14 am ]
Post subject: 

hdparm can checked disk access speeds.

Author:  baishen78 [ Thu Nov 02, 2006 8:43 am ]
Post subject: 

mogwa_ wrote:
hdparm can checked disk access speeds.


How do I do that?

Author:  mogwa_ [ Thu Nov 02, 2006 2:36 pm ]
Post subject: 

Code:
hdparm - get/set hard disk parameters - version v6.3

Usage:  hdparm  [options] [device] ..

Options:
 -a   get/set fs readahead
 -A   set drive read-lookahead flag (0/1)
 -b   get/set bus state (0 == off, 1 == on, 2 == tristate)
 -B   set Advanced Power Management setting (1-255)
 -c   get/set IDE 32-bit IO setting
 -C   check IDE power mode status
 -d   get/set using_dma flag
 --direct  use O_DIRECT to bypass page cache for timings
 -D   enable/disable drive defect management
 -E   set cd-rom drive speed
 -f   flush buffer cache for device on exit
 -g   display drive geometry
 -h   display terse usage information
 -i   display drive identification
 -I   detailed/current information directly from drive
 --Istdin  read identify data from stdin as ASCII hex
 --Istdout write identify data to stdout as ASCII hex
 -k   get/set keep_settings_over_reset flag (0/1)
 -K   set drive keep_features_over_reset flag (0/1)
 -L   set drive doorlock (0/1) (removable harddisks only)
 -M   get/set acoustic management (0-254, 128: quiet, 254: fast) (EXPERIMENTAL)
 -m   get/set multiple sector count
 -n   get/set ignore-write-errors flag (0/1)
 -p   set PIO mode on IDE interface chipset (0,1,2,3,4,...)
 -P   set drive prefetch count
 -q   change next setting quietly
 -Q   get/set DMA tagged-queuing depth (if supported)
 -r   get/set device  readonly flag (DANGEROUS to set)
 -R   register an IDE interface (DANGEROUS)
 -S   set standby (spindown) timeout
 -t   perform device read timings
 -T   perform cache read timings
 -u   get/set unmaskirq flag (0/1)
 -U   un-register an IDE interface (DANGEROUS)
 -v   defaults; same as -mcudkrag for IDE drives
 -V   display program version and exit immediately
 -w   perform device reset (DANGEROUS)
 -W   set drive write-caching flag (0/1) (DANGEROUS)
 -x   tristate device for hotswap (0/1) (DANGEROUS)
 -X   set IDE xfer mode (DANGEROUS)
 -y   put IDE drive in standby mode
 -Y   put IDE drive to sleep
 -Z   disable Seagate auto-powersaving mode
 -z   re-read partition table
 --security-help  display help for ATA security commands


try this as root.

Code:
hdparm -t -T /dev/hda


on my gaming system i got this with seagate sata disk.

Code:
wireless:~ # hdparm -t -T /dev/sda

/dev/sda:
 Timing cached reads:   3948 MB in  2.00 seconds = 1973.45 MB/sec
 Timing buffered disk reads:  178 MB in  3.01 seconds =  59.09 MB/sec
wireless:~ #

Author:  nigelpearson [ Sun Nov 05, 2006 12:12 am ]
Post subject: 

baishen78 wrote:
I have no idea why commflag is only using 15%. And no, this isn't live tv. I don't watch live tv at all anymore.

Is there a way to check if my bottleneck is the hard drive?


1) run 3 or 4 commflag commands at once, and see what the CPU usage does. If it doesn't go much above 15%, then all of your commflags are waiting for the files from disk.

2) Observe the % wa field in 'top'. High wait often means the your disk is the bottleneck.


BTW, how are you measuring your 15%? Using the top command?

I ask because I thought User Jobs are usually niced, which would actually make the '% ni' value the commflag CPU load.

Author:  nigelpearson [ Sun Nov 05, 2006 12:17 am ]
Post subject: 

For comparison:

% sudo hdparm -t -T /dev/hda

/dev/hda:
Timing cached reads: 932 MB in 2.01 seconds = 464.45 MB/sec
Timing buffered disk reads: 132 MB in 3.03 seconds = 43.57 MB/sec
% sudo hdparm -t -T /dev/hdb

/dev/hdb:
Timing cached reads: 924 MB in 2.00 seconds = 461.15 MB/sec
Timing buffered disk reads: 172 MB in 3.02 seconds = 57.04 MB/sec

%

(this is an AMD XP2400 on a GigaByte VIA motherboard. I think the second drive is 7200RPM 8MB cache:
hda: Maxtor 6Y080L0, ATA DISK drive
hdb: WDC WD1600JB-00GVA0, ATA DISK drive)

Page 1 of 1 All times are UTC - 6 hours
Powered by phpBB® Forum Software © phpBB Group
http://www.phpbb.com/