Agreed, you need to consider DoS attacks. I have that in my mind under security and not performance. I'd imagine the test methodology would be completely different since you no longer are attempting to simulate real world traffic.<div>
<br></div><div><br><div>Ian<br><br><div class="gmail_quote">On Thu, Oct 4, 2012 at 5:55 AM, Joel Joonatan Kaartinen <span dir="ltr"><<a href="mailto:joel.kaartinen@gmail.com" target="_blank">joel.kaartinen@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">For script evaluation benchmarking, I don't think just a good<br>
approximation of real-world traffic is enough. You really need to<br>
benchmark the worst case scenarios, otherwise you could be creating a<br>
DoS vulnerability.<br>
<br>
- Joel<br>
<br>
ke, 2012-10-03 kello 13:57 -0400, Ian Miers kirjoitti:<br>
<div><div class="h5">> Script evaluation performance was what I was primarily concerned<br>
> with. I'm fooling around with adding some new instruction types.<br>
> The tricky part is that to test how that effects performance, you need<br>
> to be able to intersperse transactions with the new instructions with<br>
> existing ones. For accuracy, you'd like your simulated traffic to at<br>
> least approximate the real world traffic.<br>
><br>
><br>
><br>
><br>
> Also, is there any bench-marking / instrumentation in bitcoind ?<br>
><br>
><br>
> Ian<br>
> On Wed, Oct 3, 2012 at 1:43 PM, Jeff Garzik <<a href="mailto:jgarzik@exmulti.com">jgarzik@exmulti.com</a>><br>
> wrote:<br>
> On Wed, Oct 3, 2012 at 1:38 PM, Ian Miers <<a href="mailto:imiers1@jhu.edu">imiers1@jhu.edu</a>><br>
> wrote:<br>
> > Whats the best way to get performance numbers for<br>
> modifications to bitcoin ?<br>
> > Profiling it while running on testnet might work, but that<br>
> would take a<br>
> > rather long time to get data.<br>
> > Is there anyway to speed this up if we only needed to<br>
> provide relative<br>
> > performance between tests. (in a sense a fast performance<br>
> regression test).<br>
><br>
><br>
> You have to be specific about what you're measuring, because<br>
> "performance" is vague.<br>
><br>
> You can measure many aspects of blockchain performance by<br>
> importing<br>
> blocks via -loadblock=FILE.<br>
><br>
> Other performance measurements like "how fast does a block<br>
> relay<br>
> through the network" cannot be as easily measured.<br>
><br>
> --<br>
> Jeff Garzik<br>
> exMULTI, Inc.<br>
> <a href="mailto:jgarzik@exmulti.com">jgarzik@exmulti.com</a><br>
><br>
><br>
</div></div>> ------------------------------------------------------------------------------<br>
> Don't let slow site performance ruin your business. Deploy New Relic APM<br>
> Deploy New Relic app performance management and know exactly<br>
> what is happening inside your Ruby, Python, PHP, Java, and .NET app<br>
> Try New Relic at no cost today and get our sweet Data Nerd shirt too!<br>
> <a href="http://p.sf.net/sfu/newrelic-dev2dev" target="_blank">http://p.sf.net/sfu/newrelic-dev2dev</a><br>
> _______________________________________________ Bitcoin-development mailing list <a href="mailto:Bitcoin-development@lists.sourceforge.net">Bitcoin-development@lists.sourceforge.net</a> <a href="https://lists.sourceforge.net/lists/listinfo/bitcoin-development" target="_blank">https://lists.sourceforge.net/lists/listinfo/bitcoin-development</a><br>
<br>
<br>
</blockquote></div><br></div></div>