View unanswered posts    View active topics

All times are UTC - 6 hours





Post new topic Reply to topic  [ 8 posts ] 
Print view Previous topic   Next topic  
Author Message
Search for:
 Post subject: Job Queueing
PostPosted: Mon Oct 02, 2006 12:36 pm 
Offline
Joined: Sun Aug 27, 2006 2:31 pm
Posts: 287
I'd like to finetune my job queueing. I know that I can specify the number of jobs run at once, and when the jobs are run, but I'd like to specify different parameters for different jobs.

For example, commercial flagging only uses about 15% of my cpu. So I'd like to run 2-3 of them at once, and allow them to run at any time.

However, transcoding takes up the entire cpu, so I only want to run one transcoding job at a time, and no other jobs while it's running. And since my myth box gets a little laggy while the transcoding job is running, I'd like to limit it's run time to when I'm asleep or at work.

Can this be done?

_________________
KM R5E50; K8NGM2; A64-3800+; 1024MB PC3200; LG DVD-RW; Seagate 750GB; 6600 PCI-E; Onboard sound; Hauppauge PVR-150


Top
 Profile  
 
 Post subject:
PostPosted: Mon Oct 02, 2006 5:53 pm 
Offline
Joined: Wed Apr 28, 2004 10:42 pm
Posts: 405
Location: Bendigo, Victoria, Australia
Why doesn't comm flagging use any more CPU time than 15%?

If it is currently limited by hard disk bandwidth then running more than one isn't going to go any quicker. You'd just have two processes using 7% CPU each.

Or is this for Live TV?

_________________
Paul Turpie
-------------
<--Is your location in your profile? Why not?


Top
 Profile  
 
 Post subject:
PostPosted: Tue Oct 03, 2006 8:20 am 
Offline
Joined: Sun Aug 27, 2006 2:31 pm
Posts: 287
I have no idea why commflag is only using 15%. And no, this isn't live tv. I don't watch live tv at all anymore.

Is there a way to check if my bottleneck is the hard drive?

_________________
KM R5E50; K8NGM2; A64-3800+; 1024MB PC3200; LG DVD-RW; Seagate 750GB; 6600 PCI-E; Onboard sound; Hauppauge PVR-150


Top
 Profile  
 
 Post subject:
PostPosted: Thu Nov 02, 2006 7:14 am 
Offline
Joined: Mon Mar 20, 2006 9:03 am
Posts: 17
hdparm can checked disk access speeds.

_________________
AMD Athlon XP 3000
768MB RAM DDR 2100
250 PATA Seagate HDD
2 x Nova-T
Cooler Master Cavalar case.
Knoppmyth R5E50


Top
 Profile  
 
 Post subject:
PostPosted: Thu Nov 02, 2006 8:43 am 
Offline
Joined: Sun Aug 27, 2006 2:31 pm
Posts: 287
mogwa_ wrote:
hdparm can checked disk access speeds.


How do I do that?

_________________
KM R5E50; K8NGM2; A64-3800+; 1024MB PC3200; LG DVD-RW; Seagate 750GB; 6600 PCI-E; Onboard sound; Hauppauge PVR-150


Top
 Profile  
 
 Post subject:
PostPosted: Thu Nov 02, 2006 2:36 pm 
Offline
Joined: Mon Mar 20, 2006 9:03 am
Posts: 17
Code:
hdparm - get/set hard disk parameters - version v6.3

Usage:  hdparm  [options] [device] ..

Options:
 -a   get/set fs readahead
 -A   set drive read-lookahead flag (0/1)
 -b   get/set bus state (0 == off, 1 == on, 2 == tristate)
 -B   set Advanced Power Management setting (1-255)
 -c   get/set IDE 32-bit IO setting
 -C   check IDE power mode status
 -d   get/set using_dma flag
 --direct  use O_DIRECT to bypass page cache for timings
 -D   enable/disable drive defect management
 -E   set cd-rom drive speed
 -f   flush buffer cache for device on exit
 -g   display drive geometry
 -h   display terse usage information
 -i   display drive identification
 -I   detailed/current information directly from drive
 --Istdin  read identify data from stdin as ASCII hex
 --Istdout write identify data to stdout as ASCII hex
 -k   get/set keep_settings_over_reset flag (0/1)
 -K   set drive keep_features_over_reset flag (0/1)
 -L   set drive doorlock (0/1) (removable harddisks only)
 -M   get/set acoustic management (0-254, 128: quiet, 254: fast) (EXPERIMENTAL)
 -m   get/set multiple sector count
 -n   get/set ignore-write-errors flag (0/1)
 -p   set PIO mode on IDE interface chipset (0,1,2,3,4,...)
 -P   set drive prefetch count
 -q   change next setting quietly
 -Q   get/set DMA tagged-queuing depth (if supported)
 -r   get/set device  readonly flag (DANGEROUS to set)
 -R   register an IDE interface (DANGEROUS)
 -S   set standby (spindown) timeout
 -t   perform device read timings
 -T   perform cache read timings
 -u   get/set unmaskirq flag (0/1)
 -U   un-register an IDE interface (DANGEROUS)
 -v   defaults; same as -mcudkrag for IDE drives
 -V   display program version and exit immediately
 -w   perform device reset (DANGEROUS)
 -W   set drive write-caching flag (0/1) (DANGEROUS)
 -x   tristate device for hotswap (0/1) (DANGEROUS)
 -X   set IDE xfer mode (DANGEROUS)
 -y   put IDE drive in standby mode
 -Y   put IDE drive to sleep
 -Z   disable Seagate auto-powersaving mode
 -z   re-read partition table
 --security-help  display help for ATA security commands


try this as root.

Code:
hdparm -t -T /dev/hda


on my gaming system i got this with seagate sata disk.

Code:
wireless:~ # hdparm -t -T /dev/sda

/dev/sda:
 Timing cached reads:   3948 MB in  2.00 seconds = 1973.45 MB/sec
 Timing buffered disk reads:  178 MB in  3.01 seconds =  59.09 MB/sec
wireless:~ #

_________________
AMD Athlon XP 3000
768MB RAM DDR 2100
250 PATA Seagate HDD
2 x Nova-T
Cooler Master Cavalar case.
Knoppmyth R5E50


Top
 Profile  
 
 Post subject:
PostPosted: Sun Nov 05, 2006 12:12 am 
Offline
Joined: Wed Mar 03, 2004 7:43 pm
Posts: 748
Location: Sydney, Australia
baishen78 wrote:
I have no idea why commflag is only using 15%. And no, this isn't live tv. I don't watch live tv at all anymore.

Is there a way to check if my bottleneck is the hard drive?


1) run 3 or 4 commflag commands at once, and see what the CPU usage does. If it doesn't go much above 15%, then all of your commflags are waiting for the files from disk.

2) Observe the % wa field in 'top'. High wait often means the your disk is the bottleneck.


BTW, how are you measuring your 15%? Using the top command?

I ask because I thought User Jobs are usually niced, which would actually make the '% ni' value the commflag CPU load.

_________________
| Nigel Pearson, nigel.pearson.au@gmail.com
| "Things you own end up owning you" - Tyler, Fight Club


Top
 Profile  
 
 Post subject:
PostPosted: Sun Nov 05, 2006 12:17 am 
Offline
Joined: Wed Mar 03, 2004 7:43 pm
Posts: 748
Location: Sydney, Australia
For comparison:

% sudo hdparm -t -T /dev/hda

/dev/hda:
Timing cached reads: 932 MB in 2.01 seconds = 464.45 MB/sec
Timing buffered disk reads: 132 MB in 3.03 seconds = 43.57 MB/sec
% sudo hdparm -t -T /dev/hdb

/dev/hdb:
Timing cached reads: 924 MB in 2.00 seconds = 461.15 MB/sec
Timing buffered disk reads: 172 MB in 3.02 seconds = 57.04 MB/sec

%

(this is an AMD XP2400 on a GigaByte VIA motherboard. I think the second drive is 7200RPM 8MB cache:
hda: Maxtor 6Y080L0, ATA DISK drive
hdb: WDC WD1600JB-00GVA0, ATA DISK drive)

_________________
| Nigel Pearson, nigel.pearson.au@gmail.com
| "Things you own end up owning you" - Tyler, Fight Club


Top
 Profile  
 

Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 8 posts ] 


All times are UTC - 6 hours




Who is online

Users browsing this forum: No registered users and 8 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Jump to:  
cron
Powered by phpBB® Forum Software © phpBB Group

Theme Created By ceyhansuyu