<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Hello Junxiao, </div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
I compiled (took me about 10hrs) ndn-cxx, nfd, PSync manually on Pi Zero using <span style="font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255); display: inline !important">clang++-3.9</span>, and now everything is working
fine.<span style="color: rgb(0, 0, 0); font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"> This indeed suggests the packaging might have produced invalid binaries. </span></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<span style="color: rgb(0, 0, 0); font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><br>
</span></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<span style="color: rgb(0, 0, 0); font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;">Regards,</span></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<span style="color: rgb(0, 0, 0); font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;">Saurab Dulal</span></div>
<div id="Signature">
<div id="divtagdefaultwrapper" style="font-size:12pt; color:#000000; background-color:#FFFFFF; font-family:Calibri,Arial,Helvetica,sans-serif">
</div>
</div>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Junxiao Shi <shijunxiao@email.arizona.edu><br>
<b>Sent:</b> Saturday, March 14, 2020 7:48 AM<br>
<b>To:</b> Saurab Dulal (sdulal) <sdulal@memphis.edu><br>
<b>Cc:</b> <nfd-dev@lists.cs.ucla.edu> <nfd-dev@lists.cs.ucla.edu><br>
<b>Subject:</b> Re: [EXT][Nfd-dev] Failure to synchronize using PSync full-sync on Raspberry pi zero.</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div>Hi Saurab</div>
<div><br>
</div>
<div>While I offered these Raspberry Pi Zero packages, they aren't tested.<br>
</div>
<div>The OpenCV3 packages were built on RPi Zero hardware, which <a href="https://yoursunny.com/t/2018/build-OpenCV3">
took several days</a>, and many people are using them.<br>
</div>
<div>The NDN packages were built on a Xeon server in Docker <a href="https://hub.docker.com/r/balenalib/raspberry-pi">
balenalib/raspberry-pi</a> image using <a href="https://github.com/yoursunny/docker-nfd/blob/886b036c84ef407fe822ffd29f7e4f11e84a239c/debuild.sh">
this script</a>. If you can confirm the produced invalid binaries, I suggest seeking support from
<a href="https://www.balena.io/support">
balena</a>.</div>
<div><br>
</div>
<div>For RPi Zero hardware, my current recommendation for running C++ software is to use OpenWrt, not Raspbian.</div>
<div>My package feed includes ndn-cxx and NFD: <a href="https://github.com/yoursunny/OpenWrt-packages">
https://github.com/yoursunny/OpenWrt-packages</a></div>
<div>If you need PSync and other software, look at this guide: <a href="https://openwrt.org/docs/guide-developer/helloworld/start">
https://openwrt.org/docs/guide-developer/helloworld/start</a></div>
<div><br>
</div>
<div>Yours, Junxiao<br>
</div>
<br>
<div class="x_gmail_quote">
<div dir="ltr" class="x_gmail_attr">On Fri, Mar 13, 2020 at 2:33 PM Saurab Dulal (sdulal) <<a href="mailto:sdulal@memphis.edu">sdulal@memphis.edu</a>> wrote:<br>
</div>
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left:1px solid rgb(204,204,204); padding-left:1ex">
<div dir="ltr">
<p style="text-align:center"><font color="red"><b>External Email</b><br>
</font></p>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="font-family:monospace; font-size:12pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">Hello Everyone, </span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="font-family:monospace; font-size:12pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">I am trying to synchronize two
</span><span style="font-family:monospace; font-size:12pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"><b>Raspberry pi zero</b></span><span style="font-family:monospace; font-size:12pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"> (ARMv6, Raspbian
GNU/Linux 9 (stretch), Linux 4.14.98+)</span><span style="font-family:monospace; font-size:12pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"> using PSync full-sync.</span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="color:rgb(0,0,0); font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt"><br>
</span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="color:rgb(0,0,0); font-family:monospace; font-size:12pt; background-color:rgba(0,0,0,0)">ndn (0.7.0) is installed using the ndn Debian packages </span><span style="color:rgb(0,0,0); font-family:monospace; font-size:12pt; background-color:rgba(0,0,0,0)">[</span><span style="color:rgb(0,0,0); font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt"><span style="font-size:11pt; font-family:arial; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"><span style="font-family:monospace; font-size:12pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"><a href="http://dl.bintray.com/yoursunny/PiZero" target="_blank">http://dl.bintray.com/yoursunny/PiZero</a></span></span></span><span style="color:rgb(0,0,0); font-size:12pt; background-color:rgba(0,0,0,0); font-family:monospace">],
and the PSync, as well as full-sync application, are compiled using gcc (version 6.3.0 20170516) - have also tried clang. The configuration and setting are same on both the pi's.
</span><span style="color:rgb(0,0,0); font-size:12pt; background-color:rgba(0,0,0,0); font-family:monospace"><b>/sync</b>
</span><span style="color:rgb(0,0,0); font-size:12pt; background-color:rgba(0,0,0,0); font-family:monospace">is used as sync prefix</span><span style="color:rgb(0,0,0); font-size:12pt; background-color:rgba(0,0,0,0); font-family:monospace">,</span><span style="color:rgb(0,0,0); font-size:12pt; background-color:rgba(0,0,0,0); font-family:monospace">
and the application prefixes are</span><span style="color:rgb(0,0,0); font-size:12pt; background-color:rgba(0,0,0,0); font-family:monospace">
<b>/a</b></span><span style="color:rgb(0,0,0); font-size:12pt; background-color:rgba(0,0,0,0); font-family:monospace"> and
</span><span style="color:rgb(0,0,0); font-size:12pt; background-color:rgba(0,0,0,0); font-family:monospace"><b>/b</b></span><span style="color:rgb(0,0,0); font-size:12pt; background-color:rgba(0,0,0,0); font-family:monospace"> respectively for two pi's. </span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="color:rgb(0,0,0); font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt"><br>
</span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="font-family:monospace; font-size:12pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">Every time I run the applications on the nodes to synchronize the states, I encounter the following problems. </span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<p dir="ltr" style="line-height:1.2; margin-top:0pt; margin-bottom:0pt"><span style="font-size:12pt; font-family:monospace; color:rgb(0,0,0); line-height:normal; background-color:rgba(0,0,0,0)">the full-sync application on one of the node hangs up, and stops
publishing, or crash with the following error: </span><span style="font-size:12pt; font-family:monospace; color:rgb(0,0,0); line-height:normal; background-color:rgba(0,0,0,0)">(</span><span style="font-size:12pt; font-family:monospace; color:rgb(0,0,0); line-height:normal; background-color:rgba(0,0,0,0)">__gnu_cxx::__concurrence_lock_error</span><span style="font-size:12pt; font-family:monospace; color:rgb(0,0,0); line-height:normal; background-color:rgba(0,0,0,0)">).<br>
</span><span style="background-color:rgba(0,0,0,0); color:rgb(0,0,0); font-family:monospace; font-size:12pt"><br>
</span></p>
</div>
<blockquote style="margin:0px 0px 0px 40px; border:medium none; padding:0px">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<p dir="ltr" style="line-height:1.2; margin-top:0pt; margin-bottom:0pt"><span style="background-color:rgba(0,0,0,0); color:rgb(0,0,0); font-family:monospace; font-size:11pt; line-height:normal">1583881471.476280 DEBUG: [psync.FullProducer] Checking if data
will satisfy our own pending interest</span></p>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<p dir="ltr" style="line-height:1.2; margin-top:0pt; margin-bottom:0pt"><span style="background-color:rgba(0,0,0,0); color:rgb(0,0,0); font-family:monospace; font-size:11pt; line-height:normal">1583881471.479401 DEBUG: [psync.FullProducer] Sending Sync Data
<b>(stucks here)</b> </span></p>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="font-size:11pt; font-family:monospace; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">1583881471.504475 ERROR: [examples.FullSyncApp]
</span><span style="font-size:11pt; font-family:monospace; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">__gnu_cxx::__concurrence_lock_error
<b>(or crashes here)</b></span></div>
</blockquote>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="font-family:monospace; font-size:12pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">Nothing happens to nfd, it runs perfectly fine even after the app crashes. </span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"><b>(gdb) bt</b></span><br>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#0 0xb66b5f10 in __lll_lock_wait (futex=futex@entry=0x56bb4, private=0) at lowlevellock.c:46</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#1 0xb66aebd4 in __GI___pthread_mutex_lock (mutex=0x56bb4) at pthread_mutex_lock.c:80</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#2 0xb6d097fc in ndn::InMemoryStorageEntry::setData(ndn::Data const&) ()</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"> from /usr/lib/arm-linux-gnueabihf/libndn-cxx.so.0.7.0</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#3 0xb6d126c0 in ndn::InMemoryStorage::insert(ndn::Data const&, boost::chrono::duration<long long, boost::ratio<1ll, 1000ll> > const&) () from /usr/lib/arm-linux-gnueabihf/libndn-cxx.so.0.7.0</span><br>
</div>
<div><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#4 0xb66917fc in psync::SegmentPublisher::publish (this=<optimized out>, interestName=..., dataName=...,</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"> buffer=..., freshness=..., signingInfo=...) at ../PSync/segment-publisher.cpp:91</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#5 0xb66857cc in psync::FullProducer::sendSyncData (this=<optimized out>, name=..., block=...)</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"> at ../PSync/full-producer.cpp:252</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#6 0xb6684c24 in psync::FullProducer::satisfyPendingInterests (this=<optimized out>)</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"> at ../PSync/full-producer.cpp:341</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#7 0xb66843d8 in psync::FullProducer::publishName (this=<optimized out>, prefix=..., seq=...)</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"> at ../PSync/full-producer.cpp:80</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#8 0x00018a14 in Producer::doUpdate(ndn::Name const&) ()</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#9 0x00018354 in Producer::Producer(ndn::Name const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int, int)::{lambda()#1}::operator()()
const ()</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#10 0x0001c060 in std::_Function_handler<void (), Producer::Producer(ndn::Name const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>
> const&, int, int)::{lambda()#1}>::_M_invoke(std::_Any_data const&)</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"> ()</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">---Type <return> to continue, or q <return> to quit---</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#11 0xb6f0fea8 in ndn::scheduler::Scheduler::executeEvent(boost::system::error_code const&) ()</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"> from /usr/lib/arm-linux-gnueabihf/libndn-cxx.so.0.7.0</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"><b>#12 0xb6f10190 in ?? () from /usr/lib/arm-linux-gnueabihf/libndn-cxx.so.0.7.0</b></span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#13 0xb6cfb594 in boost::asio::detail::task_io_service::run(boost::system::error_code&) ()</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"> from /usr/lib/arm-linux-gnueabihf/libndn-cxx.so.0.7.0</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#14 0xb6cf75c8 in ndn::Face::doProcessEvents(boost::chrono::duration<long long, boost::ratio<1ll, 1000ll> >, bool)</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"> () from /usr/lib/arm-linux-gnueabihf/libndn-cxx.so.0.7.0</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#15 0x00017bcc in ndn::Face::processEvents(boost::chrono::duration<long long, boost::ratio<1ll, 1000ll> >, bool) ()</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#16 0x00018910 in Producer::run() ()</span><br>
</div>
<div><span style="font-family:monospace; font-size:11pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">#17 0x000166a4 in main ()</span></div>
<div><span style="font-family:monospace; font-size:12pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)"><br>
</span></div>
<div><span style="font-family:Consolas,Courier,monospace; font-size:11pt"><b>(gdb) i thr</b></span><br>
</div>
<div><span style="font-family:Consolas,Courier,monospace; font-size:11pt"> Id Target Id Frame</span><br>
</div>
<div><span style="font-family:Consolas,Courier,monospace; font-size:11pt">* 1 Thread 0xb6ff1000 (LWP 1042) "full-sync" 0xb66b5f10 in __lll_lock_wait (futex=futex@entry=0x56bb4, private=0)</span><br>
</div>
<div><span style="font-family:Consolas,Courier,monospace; font-size:11pt"> at lowlevellock.c:46</span><br>
</div>
<span style="font-family:Consolas,Courier,monospace; font-size:11pt"> 2 Thread 0xb455fa70 (LWP 1048) "full-sync" syscall () at ../sysdeps/unix/sysv/linux/arm/syscall.S:37</span><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="color:rgb(0,0,0); font-family:Consolas,Courier,monospace; font-size:12pt">Memory and CPU utilization are in the normal range.</span><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="color:rgb(0,0,0); font-family:Consolas,Courier,monospace; font-size:12pt"><br>
</span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="color:rgb(0,0,0); font-family:Consolas,Courier,monospace; font-size:12pt">I can't figure out anything from gdb. Any help will be really appreciated. </span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="color:rgb(0,0,0); font-family:Consolas,Courier,monospace; font-size:12pt"><br>
</span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="color:rgb(0,0,0); font-family:Consolas,Courier,monospace; font-size:12pt">By the way, everything works perfectly fine on Pi 3 and 4. I have only observed this on pi zero. </span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="font-size:12pt"></span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="font-family:consolas,courier,monospace; font-size:12pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">Regards,</span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="font-family:consolas,courier,monospace; font-size:12pt; color:rgb(0,0,0); background-color:rgba(0,0,0,0)">Saurab Dulal</span></div>
<div>
<div id="x_gmail-m_-5938590756778642435Signature">
<div id="x_gmail-m_-5938590756778642435divtagdefaultwrapper" style="font-size:12pt; color:rgb(0,0,0); background-color:rgb(255,255,255); font-family:Calibri,Arial,Helvetica,sans-serif">
</div>
</div>
</div>
</div>
<br>
</blockquote>
</div>
</div>
</div>
</body>
</html>