Received: from sog-mx-1.v43.ch3.sourceforge.com ([172.29.43.191] helo=mx.sourceforge.net) by sfs-ml-4.v29.ch3.sourceforge.com with esmtp (Exim 4.76) (envelope-from ) id 1WkXWS-0002qV-Ib for bitcoin-development@lists.sourceforge.net; Wed, 14 May 2014 11:38:56 +0000 Received-SPF: pass (sog-mx-1.v43.ch3.sourceforge.com: domain of gmail.com designates 209.85.216.180 as permitted sender) client-ip=209.85.216.180; envelope-from=jameson.lopp@gmail.com; helo=mail-qc0-f180.google.com; Received: from mail-qc0-f180.google.com ([209.85.216.180]) by sog-mx-1.v43.ch3.sourceforge.com with esmtps (TLSv1:RC4-SHA:128) (Exim 4.76) id 1WkXWR-00024E-Ax for bitcoin-development@lists.sourceforge.net; Wed, 14 May 2014 11:38:56 +0000 Received: by mail-qc0-f180.google.com with SMTP id i17so2498301qcy.25 for ; Wed, 14 May 2014 04:38:49 -0700 (PDT) X-Received: by 10.140.87.243 with SMTP id r106mr4448674qgd.75.1400067529866; Wed, 14 May 2014 04:38:49 -0700 (PDT) Received: from [192.168.119.214] (BRONTO-SOFT.car1.Raleigh1.Level3.net. [4.59.160.2]) by mx.google.com with ESMTPSA id y79sm977998qgy.18.2014.05.14.04.38.48 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 14 May 2014 04:38:48 -0700 (PDT) Message-ID: <537355C8.2090700@gmail.com> Date: Wed, 14 May 2014 07:38:48 -0400 From: Jameson Lopp User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.5.0 MIME-Version: 1.0 To: Josh Lehan , Wladimir References: <536FAFEA.5050404@gmail.com>

In-Reply-To: X-Enigmail-Version: 1.6 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Spam-Score: -1.3 (-) X-Spam-Report: Spam Filtering performed by mx.sourceforge.net. See http://spamassassin.org/tag/ for more details. -1.5 SPF_CHECK_PASS SPF reports sender host as permitted sender for sender-domain 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider (jameson.lopp[at]gmail.com) -0.0 SPF_PASS SPF: sender matches SPF record 0.3 URIBL_RHS_DOB Contains an URI of a new domain (Day Old Bread) [URIs: statoshi.info] -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from author's domain 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily valid -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Headers-End: 1WkXWR-00024E-Ax Cc: Bitcoin Dev Subject: Re: [Bitcoin-development] statoshi.info is now live X-BeenThere: bitcoin-development@lists.sourceforge.net X-Mailman-Version: 2.1.9 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 May 2014 11:38:56 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Thanks; I've received several suggestions for other metrics to collect that I hope to implement soon, but you're right in that tracking per-peer pings is a different type of metric than what I'm currently collecting. I actually noted the lack of pong messages in a post I made a few weeks ago: http://coinchomp.com/2014/04/27/peeking-hood-running-bitcoin-node/ Once I added metrics for sent messages, it validated my theory: my node has never sent a single ping request to a peer and thus has never received a pong message. I can't even add sent pings or received pongs to this chart because they don't exist in my graphite instance. http://statoshi.info:8080/render/?width=1548&height=883&_salt=1400066995.622&target=stats.message.received.ping&target=stats.message.sent.pong&lineMode=connected&bgcolor=000000&fgcolor=FFFFFF I guess my question regarding ping stats is how useful that information would be - it seems to me that if we are trying to quantify the cohesiveness of the network, we should instead be observing the message propagation times. Though that's outside the scope of my project; there are other people who are doing just that. http://bitcoinstats.com/network/propagation/ Jameson On 05/13/2014 01:48 PM, Josh Lehan wrote: > I agree, it looks very slick. Well done. > > While on the subject of connected peers, what about the idea of adding the ping time from this node to other peers? The problem with fitting that information into the current design is that the graphs seem to be comprised of overall statistics for this node, not per-peer statistics that can vary between peers (such as ping time). If a line were to be added to a graph to represent each peer's ping time, the number of lines (statistics) on the graph would have to vary in real time as peers are added or removed, which would be a challenge. > > I earlier added the "ping" feature to bitcoind, and it works to measure the ping time, however this feature is on-demand: it won't ping other nodes unless requested. So, something would have to send the "ping" RPC command on a regular schedule, to ensure the graph is updated with new information. Also, there is currently no support for overlapping pings (although that would be easy to add), so if a peer is slow enough to not respond at all to the first ping request, and a second ping request goes out in the meantime, any late response from the first ping request would then be discarded. > > Great graphs, and these are just brainstorms for future ideas :) > > Josh Lehan > > Sent from my iPad > >> On May 13, 2014, at 4:43, Wladimir wrote: >> >> Hello Jameson, >> >>> On Sun, May 11, 2014 at 7:14 PM, Jameson Lopp wrote: >>> -----BEGIN PGP SIGNED MESSAGE----- >>> Hash: SHA1 >>> >>> Since it seems unlikely that we'll be able to ship an integrated stats / monitoring feature in the short term, I went ahead and set up a public Statoshi instance and threw a nicer interface on top of it. >>> >>> http://statoshi.info >> >> Must say it looks very nice. >> >> One comment about the graphs: in the 'connected peers' chart you >> visualize some larger quantities (especially knownAddresses) and some >> very small ones (peer.(dis)connect). This makes the latter invisible >> due to scale. >> >> Some random stats may be useful as well: >> >> - Number of connected peers that are SPV clients or full nodes (NODE_NETWORK) >> - Current block height (so that it's possible to detect stuck nodes) >> - Number of transactions in mempool >> - Number of transactions in UTXO set >> - Maybe some fee statistics, >> https://github.com/bitcoin/bitcoin/pull/3959 would be useful here >> - Number of orphan blocks/orphan transactions >> >> Wladimir >> >> ------------------------------------------------------------------------------ >> "Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE >> Instantly run your Selenium tests across 300+ browser/OS combos. >> Get unparalleled scalability from the best Selenium testing platform available >> Simple to use. Nothing to install. Get started now for free." >> http://p.sf.net/sfu/SauceLabs >> _______________________________________________ >> Bitcoin-development mailing list >> Bitcoin-development@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/bitcoin-development -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBAgAGBQJTc1XIAAoJEIch3FSFNiDcrygH/A+cDzLdNNwdiT2oGjpfYO/A fxlqSHqzGdTJQuTRgjxAOp9RrFGhGYT4Qz6TJ3qzSVAILyM3FYELxgm3B6TqDWi2 hc0FTFbVO3ys1Otza9r5r/6W0xGIkJaDRghoFlxd1jUCmuPyqK541pHjvX8MPAfm zYWCb5U2dU0MAzkV8vClQNMy5lMN3RulCm3lZPvetjnQXfhf2e36Pl5MFOsuqzcp PeZnuXHhxGT6BbVOoEnPRQiH7h0jmDqBV66nJaeUaLVvsg6urfo/HaUmDXuto0tF r7O779o138mLTofVxCwFvxYxilYDhS9S8L2uZc8ILt+SAZA3XQIM5okJYLd6I6A= =cJCd -----END PGP SIGNATURE-----