MIME-Version: 1.0
In-Reply-To: <CAF7tpEyPqMVXBmbNcSKKywo=sstWxca+4h6_-Tp3-5t_vofbWA@mail.gmail.com>
References: <CAOVG1oNimYpzSnB7NUuugagufbD1JnZmAWsuXhMjq45dEF=w-g@mail.gmail.com>
	<E8AC44C1-310F-44AE-AB5E-63064A3DE1BE@gmail.com>
	<CAF7tpEyPqMVXBmbNcSKKywo=sstWxca+4h6_-Tp3-5t_vofbWA@mail.gmail.com>
Date: Fri, 9 Oct 2015 10:11:58 -0700
Message-ID: <CAOVG1oOAUKhzYKfYEd20nXSqy0wcn01cO86oxBRutJJpUj9TjQ@mail.gmail.com>
From: Byron Gibson <byron@mirror.co>
To: Andrew Miller <amiller@cs.umd.edu>
Content-Type: multipart/alternative; boundary=94eb2c0b8fbccd6d780521af1300
Cc: bitcoin-dev@lists.linuxfoundation.org
Subject: Re: [bitcoin-dev] Bitcoin network simulation testing?
Precedence: list

--94eb2c0b8fbccd6d780521af1300
Content-Type: text/plain; charset=UTF-8

Thanks Nina and Andrew, I may have the capability to run a simulator large
scale on many nodes on AWS/GCE, but am looking to optimize the ROI by
selecting categories of experiments that benefit from a more controlled
environment, rather than be invalidated by its divergence/s from livenet.
But wondering if anyone else has already been doing this, would be nice to
collaborate.

Byron Gibson
CoS | http://mirrorx.com/
https://onename.io/bgibson
https://keybase.io/byrongibson


On Oct 6, 2015 14:00, "Andrew Miller" <amiller@cs.umd.edu> wrote:

> Shadow uses virtual time, entirely decoupled from real time. So while it
> may slow down your machine, this would not affect the stats collected
>
> (although it does make shadow somewhat unpleasant to run, unless you have
> a fast machine,  compared to abstract simulators that avoid running the
> actual Bitcoin code).
> Hi Byron,
>
> I've been using shadow a bit-- I think these simulators are important for
> testing, but Shadow, at least, certainly seems to have limitations, in some
> crucial respects.  Running shadow w Tor (which is only logical, because
> many BCT transactions transpire over Tor) is not as 'light' as presented
> and slows my own box down quite a bit, so the stats can't possibly be
> accurate... I don't know if this answers any questions or if you've had
> this experience at all -- perhaps it is negligible on a more powerful
> machine than my own-- or perhaps there is an adjustment still unaccounted?
>
> Regards,
> Nina K
>
> Sent from my iPhone
>
> On Oct 4, 2015, at 2:04 PM, Byron Gibson via bitcoin-dev <
> bitcoin-dev@lists.linuxfoundation.org> wrote:
>
> Hi all, is anyone using simulators like Shadow (https://shadow.github.io),
> BTCSim (https://github.com/btcsuite/btcsim), etc. to test proposed
> changes to Bitcoin?  I have a few questions about their capabilities and
> limitations.
>
> Byron Gibson
> http://mirror.co/
> https://keybase.io/byrongibson
>
>
>
> _______________________________________________
> bitcoin-dev mailing list
> bitcoin-dev@lists.linuxfoundation.org
> https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev
>
>
> _______________________________________________
> bitcoin-dev mailing list
> bitcoin-dev@lists.linuxfoundation.org
> https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev
>
>

--94eb2c0b8fbccd6d780521af1300
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<p dir=3D"ltr">Thanks Nina and Andrew, I may have the capability to run a s=
imulator large scale on many nodes on AWS/GCE, but am looking to optimize t=
he ROI by selecting categories of experiments that benefit from a more cont=
rolled environment, rather than be invalidated by its divergence/s from liv=
enet.=C2=A0 But wondering if anyone else has already been doing this, would=
 be nice to collaborate.<br></p>
<p dir=3D"ltr">Byron Gibson<br>
CoS |=C2=A0<a href=3D"http://mirrorx.com/">http://mirrorx.com/</a><br>
<a href=3D"https://onename.io/bgibson">https://onename.io/bgibson</a><br>
<a href=3D"https://keybase.io/byrongibson">https://keybase.io/byrongibson</=
a></p>
<p dir=3D"ltr">=C2=A0=C2=A0=C2=A0</p>
<div class=3D"gmail_quote">On Oct 6, 2015 14:00, &quot;Andrew Miller&quot; =
&lt;<a href=3D"mailto:amiller@cs.umd.edu">amiller@cs.umd.edu</a>&gt; wrote:=
<br type=3D"attribution"><blockquote class=3D"gmail_quote" style=3D"margin:=
0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><p dir=3D"ltr">Shad=
ow uses virtual time, entirely decoupled from real time. So while it may sl=
ow down your machine, this would not affect the stats collected</p>
<p dir=3D"ltr"> (although it does make shadow somewhat unpleasant to run, u=
nless you have a fast machine,=C2=A0 compared to abstract simulators that a=
void running the actual Bitcoin code).</p>
<div style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex=
"><div dir=3D"auto"><div>Hi Byron,=C2=A0</div><div><br></div><div>I&#39;ve =
been using shadow a bit-- I think these simulators are important for testin=
g, but Shadow, at least, certainly seems to have limitations, in some cruci=
al respects.=C2=A0 Running shadow w Tor (which is only logical, because man=
y BCT transactions transpire over Tor) is not as &#39;light&#39; as present=
ed and slows my own box down quite a bit, so the stats can&#39;t possibly b=
e accurate... I don&#39;t know if this answers any questions or if you&#39;=
ve had this experience at all -- perhaps it is negligible on a more powerfu=
l machine than my own-- or perhaps there is an adjustment still unaccounted=
?</div><div><br></div><div>Regards,</div><div>Nina K</div><div><br>Sent fro=
m my iPhone</div><div><br>On Oct 4, 2015, at 2:04 PM, Byron Gibson via bitc=
oin-dev &lt;<a href=3D"mailto:bitcoin-dev@lists.linuxfoundation.org" target=
=3D"_blank">bitcoin-dev@lists.linuxfoundation.org</a>&gt; wrote:<br><br></d=
iv><blockquote type=3D"cite"><div><p dir=3D"ltr">Hi all, is anyone using si=
mulators like Shadow (<a href=3D"https://shadow.github.io" target=3D"_blank=
">https://shadow.github.io</a>), BTCSim (<a href=3D"https://github.com/btcs=
uite/btcsim" target=3D"_blank">https://github.com/btcsuite/btcsim</a>), etc=
. to test proposed changes to Bitcoin?=C2=A0 I have a few questions about t=
heir capabilities and limitations.<br></p>
<p dir=3D"ltr">Byron Gibson<br>
<a href=3D"http://mirror.co/" target=3D"_blank">http://mirror.co/</a><br>
<a href=3D"https://keybase.io/byrongibson" target=3D"_blank">https://keybas=
e.io/byrongibson</a><br></p>
<p dir=3D"ltr">=C2=A0=C2=A0=C2=A0 </p>
</div></blockquote><blockquote type=3D"cite"><div><span>___________________=
____________________________</span><br><span>bitcoin-dev mailing list</span=
><br><span><a href=3D"mailto:bitcoin-dev@lists.linuxfoundation.org" target=
=3D"_blank">bitcoin-dev@lists.linuxfoundation.org</a></span><br><span><a hr=
ef=3D"https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev" targe=
t=3D"_blank">https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev=
</a></span><br></div></blockquote></div><br>_______________________________=
________________<br>
bitcoin-dev mailing list<br>
<a href=3D"mailto:bitcoin-dev@lists.linuxfoundation.org" target=3D"_blank">=
bitcoin-dev@lists.linuxfoundation.org</a><br>
<a href=3D"https://lists.linuxfoundation.org/mailman/listinfo/bitcoin-dev" =
rel=3D"noreferrer" target=3D"_blank">https://lists.linuxfoundation.org/mail=
man/listinfo/bitcoin-dev</a><br>
<br></div>
</blockquote></div>

--94eb2c0b8fbccd6d780521af1300--