Hi Steve,<br><br>This looks like a good idea to me. The test suites could act similarly to the 100% Pure Java approach that successfully fended off a lot of corrupting influences to Java over the years.<br><br>Maybe it's worth putting together a small starter suite of tests and showing them to the community then providing a suitable process, perhaps through BIPs, to allow tests to be created, reviewed and updated before getting incorporated into a reference. I imagine a BIP would cover an aspect of the blockchain rather than a single test or test suite since having that many BIPs would get onerous fast.<br>
<br>Kind regards,<br><br>Gary<br><br><div class="gmail_quote">On 1 August 2012 12:38, steve <span dir="ltr"><<a href="mailto:steve@mistfpga.net" target="_blank">steve@mistfpga.net</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
-----BEGIN PGP SIGNED MESSAGE-----<br>
Hash: SHA1<br>
<br>
Hi all,<br>
<br>
I know most of you have more important things to do, and not enough<br>
time as it is, but I would really like your feedback on the testing<br>
project.<br>
<br>
Bettermeans seemed ideal, it allowed for leaderless leadership with<br>
people being able to dip in and out of what they wanted to do.<br>
however it seems that bettermeans is in no way a finished product and<br>
is rotting fast.<br>
<br>
I would like to move away from bettermeans - whilst retaining the<br>
voting and sub workstream style of working. I would like to set<br>
something up around MantisBT (Mantis Bug Tracker) - this is an<br>
exceptionally versatile bit of software with plugins and interaction<br>
with other testing products (everything from test setups and plans to<br>
test runs and results) I would go as far as saying it is industry<br>
standard (yeah, i know about bugzilla, etc. mantis beats them all<br>
hands down.) obviously we would need a wiki and other software - this<br>
is not a problem.<br>
<br>
I am happpy to pay for the VPS' to host this stuff and set it all up.<br>
<br>
I have quite a bit of experience with mantis and other opensource<br>
testing stuff.<br>
<br>
I see the testing of bitcoin to be very similar to the testing process<br>
in the games industry. for those that do not know how this works it<br>
is like this:-<br>
<br>
A company comes up with a device (xbox/ps),<br>
They then publish a set of dos and donts for this device (TRC for sony<br>
and TCRs for microsoft. - I wrote quite a few of the MS TCR's for the<br>
original xbox.)<br>
They (ms/sony) then test your game against these rules and depending<br>
on how many you pass/fail your game can be released or not.<br>
<br>
I see this as mapping to bitcoin very well, the device is the<br>
blockchain, and the TRC/TCR _tests_ are published so third party<br>
developers can see how they fair [look at gavins recent blockchain<br>
edge cases for an example] (ms/sony do not publish their testcases<br>
only the requirements)<br>
<br>
I believe that this will allow the bitcoin testing project to be able<br>
to cope with the stable builds, bleeding edge builds and 3rd party<br>
implementations all at the same time.<br>
<br>
It doesnt matter what the app is, it is its interaction with the<br>
blockchain, the safe guarding of the blockchain and compatibility with<br>
the previous/future versions that are tested.<br>
<br>
[for the bitcoin dev list]<br>
A little about me:-<br>
The below is more or less a cut and paste of some of the stuff I sent<br>
gavin in my initial email about wanting to be in on the project.<br>
<br>
I can back all of this up with references. I can go into more detail if<br>
needed.<br>
<br>
I was heavily involved with setting up the microsoft xbox european cert<br>
department<br>
I set up qa department for europes largest independant games developer<br>
(although they are no longer)<br>
<br>
worked for microsoft secure science designing security automation tools<br>
<br>
setup the internal pentest for thales e-security (now TITS [Thales<br>
Information Technology Solutions (or Trotters Independant Traders ;),<br>
on thier datacryptors (fpga, crypto and product) - have done full test<br>
cycles on hsm 8000, payshield 9000, dc2k and thier latest line of<br>
military spec comms equipment.<br>
<br>
Setup and pentested Thales and nCiphers credit control software (to<br>
fips level 4 standard - This shit bitcoin exchanges need!! I know bank<br>
is a dirty word in the bitcoin world, but we should be at least as<br>
secure as them)<br>
<br>
I currently find exploits in stuff like office, quicktime, ie, ff, etc<br>
and sell them to companies like ZDI (3com) iDefense (verisgn) and some<br>
pentest companies that require zero day exploits.<br>
<br>
however I would like to ditch this and get my bitcoin related stuff<br>
off the ground - with the BTP being top of the list.<br>
<br>
my spelling is rubbish, and sometimes i forget to spellcheck before i<br>
hit send. sorry about that.<br>
<br>
any feedback would be really appreciated. please! I feel that this has<br>
stagnated enough and I want to get my work out there and I want it to<br>
be useful. (I lost 60 or so testcases because Kev left himself logged<br>
into bettermeans and I added them under his account... none appeared<br>
on the wiki, none appeared anywhere...)<br>
<br>
There is already lots of stuff on the wiki that outlines how i see<br>
things holding together - but you cant see who posted what because of<br>
a bug that has appeared recently [meta info is just displayed as its<br>
meta tag, {name} on {date} wrote.]<br>
<br>
as apposed to Mistfpga on 30/8/2012 wrote...<br>
<br>
so the tl;dr<br>
1 - I want to use something other than bettermeans<br>
2 - I can admin opensource software to do the same<br>
3 - I want to take the voting/hiearachy style from bettermeans and<br>
apply it to mantis and test workflow.<br>
4 - I want to get some testing done asap.<br>
5 - I have a full msdn and technet licence<br>
6 - I have a vast array of machines [nearly 100 cores] that I can use<br>
to automate testing and to test different setups.<br>
7 - been mining for 18 months or so.<br>
<br>
cheers,<br>
<br>
steve<br>
<br>
I do not belive this to be related, but I am not ashamed and feel no<br>
stigma. I have posted this on a public forum. I suffer from fast<br>
cycling (withing a day) type two bipolar disorder. This has been and<br>
is being managed very well by my meds (300mg quetiapine fumerate and<br>
30mg mirtrazipine at night) I have been well for over a year now. [and<br>
yes, even with these mental health problems I still hold SCE clearance]<br>
<br>
- --<br>
my PGP public key is at <a href="http://pgp.mit.edu" target="_blank">pgp.mit.edu</a> id: 0x5016FB50<br>
<br>
-----BEGIN PGP SIGNATURE-----<br>
Version: GnuPG v2.0.17 (MingW32)<br>
Comment: Using GnuPG with Mozilla - <a href="http://enigmail.mozdev.org/" target="_blank">http://enigmail.mozdev.org/</a><br>
<br>
iQEcBAEBAgAGBQJQGRU7AAoJEFvEB9dQFvtQY9oH/RiNBeWDs+tz0NQgkgtXmxcs<br>
tDtlLWB91gRtmxvXv+yYHE0WXS/qQ5gwaor8Vek61Cvnhij4AQBf7JVYLj03/7fy<br>
cMAFJ5k7ZQmH9URo8Jx8xzQ2tLgZ5BqLbP6fTzDstpExNGJlkZvsC6hTx9OFCubU<br>
bzWuWmcIRzBiMhdz7DPoskOgie5sQRzzO0zrK7NvS1P2hyEhM3eFYFcYecpS8jq9<br>
SbkH77qnc5pZD2JULq38htVwtI16vxmg/s4GIs3OpEPaMk5xtVc5XHf6gwBZQtYw<br>
fErwZpNDEAmGidRCB4LAqdSx1Xi0ix7GOyvTxBLWTnfB7wIAQNQpBHB9zN8diiA=<br>
=am8B<br>
-----END PGP SIGNATURE-----<br>
<br>
------------------------------------------------------------------------------<br>
Live Security Virtual Conference<br>
Exclusive live event will cover all the ways today's security and<br>
threat landscape has changed and how IT managers can respond. Discussions<br>
will include endpoint security, mobile security and the latest in malware<br>
threats. <a href="http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/" target="_blank">http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/</a><br>
_______________________________________________<br>
Bitcoin-development mailing list<br>
<a href="mailto:Bitcoin-development@lists.sourceforge.net">Bitcoin-development@lists.sourceforge.net</a><br>
<a href="https://lists.sourceforge.net/lists/listinfo/bitcoin-development" target="_blank">https://lists.sourceforge.net/lists/listinfo/bitcoin-development</a><br>
</blockquote></div><br>