[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: PaceBatch and pipelining





--- Tim Bray <Tim.Bray@xxxxxxx> wrote:
> > >
> > If I wanted to post 10,000 new entries, I'd use a
> shell script and  
> > curl,
> > or maybe libwww-perl if the content varies.  How
> can it simplify the
> > programming model if I don't have to do any
> programming on the
> > client for either solution, and don't have to do
> any programming on
> > the server for the pipelining solution?
> 
> Here we're at the core of the question.  I think
> that the difficulty  
> of packing the 10K into a <batch> element and
> sending it once is not  
> qualitatively different from the script-ware
> necessary to do all the  
> individual HTTP dispatches, and I think that the
> result-processing  
> (track which ones fail) would be a *LOT* easier if
> they all came back  
> in one batch-response.

Difficulty for whom? Our server devs would HATE it if
a client could tie up server resources by requesting
that we perform 10,000 operations in sequence within a
single request instead of taking advantage of the
server's ability to parellelize requests by making
multiple requests. 

Also reading the W3C Note at
http://www.w3.org/Protocols/HTTP/Performance/Pipeline
it seems that the benefits of batching over using
multiple requests isn't clear cut. It seemed to take
some tuning of both server & client and expertise with
TCP to get the positive results from using pipelining
over using multiple requests.



THINGS TO DO IF I BECOME AN EVIL OVERLORD #222
I reserve the right to execute any henchmen who appear to be a little too intelligent, powerful, or devious. However if I do so, I will not at some subsequent point shout "Why am I surrounded by these incompetent fools?!"


		
____________________________________________________ 
Yahoo! Sports 
Rekindle the Rivalries. Sign up for Fantasy Football 
http://football.fantasysports.yahoo.com