<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">I believe the client is the problem. The protocol was that it was not at the end of the set of segments until it received a segment with the final segment number attribute matching itself. That allows for it to provide a final segment estimate early, but it can be adjusted forward if the stream is extended.<div class=""><br class=""></div><div class="">-- Nick</div><div class=""><br class=""><div class=""><br class=""><div class=""><div><blockquote type="cite" class=""><div class="">On Jul 23, 2017, at 12:43 PM, Junxiao Shi <<a href="mailto:shijunxiao@email.arizona.edu" class="">shijunxiao@email.arizona.edu</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class=""><div class="">Hi Ishita<br class=""><br class=""></div><div class="">So the problem is:<br class=""><ul class=""><li class="">ndnfs-port creates a zero-length segment if the file size is exactly 8KB.</li><li class="">The "PyNDN client" cannot correctly handle a zero-length segment.<br class=""></li></ul></div><div class="">I'm unsure which software is violating the protocol. A zero-length segment by itself is certainly not a protocol violation because it is the only way to represent an empty file, but I'm unsure about a zero-length segment at the end of a non-empty file.<br class="">I have CC'ed ndn-app, the support list of ndnfs-port. Let's see what the maintainer of ndnfs-port says about this problem.<br class=""></div><div class=""><br class=""></div><div class="">In the meanwhile, can you provide a link to the "PyNDN client" you are using? I can't find an official PyNDN-based client for NDNFS protocol.<br class=""></div><div class=""><br class=""></div>Yours, Junxiao<br class=""></div><div class="gmail_extra"><br class=""><div class="gmail_quote">On Wed, Jul 19, 2017 at 11:04 AM, Ishita Dasgupta <span dir="ltr" class=""><<a href="mailto:ishita.dasgupta@gmail.com" target="_blank" class="">ishita.dasgupta@gmail.com</a>></span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr" class=""><div class="gmail_default" style="font-family:tahoma,sans-serif">Hi Junxiao, </div><div class="gmail_default" style="font-family:tahoma,sans-serif"><br class=""></div><div class="gmail_default" style="font-family:tahoma,sans-serif">You're right. I tested with a 30MB file and it worked. Somehow for the multiples of 8KB files, the last segment is set as 0. Is there any workaround that situation or is this a bug with ndnfs-port that has not been corrected yet? Can I just change the fixed segment size of 8 KB?</div><div class="gmail_extra"><br clear="all" class=""><div class=""><div class="m_2535641639596162498m_-6880241115454691203gmail_signature" data-smartmail="gmail_signature"><div dir="ltr" class=""><div class=""><div dir="ltr" class=""><div class=""><div dir="ltr" class=""><font face="tahoma, sans-serif" class=""><span style="font-size:12.8000001907349px" class=""><div class="gmail_default" style="font-family:tahoma,sans-serif;display:inline">Thanks,</div></span></font><br class=""></div></div><div dir="ltr" class=""><font face="tahoma, sans-serif" class=""><span style="font-size:12.8000001907349px" class=""><div class="gmail_default" style="font-family:tahoma,sans-serif;display:inline">Ishita</div></span></font></div></div></div></div></div></div><div class=""><div class="h5">
<br class=""><div class="gmail_quote">On Sat, Jul 15, 2017 at 3:08 PM, Junxiao Shi <span dir="ltr" class=""><<a href="mailto:shijunxiao@email.arizona.edu" target="_blank" class="">shijunxiao@email.arizona.edu</a>></span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class=""><div dir="auto" class="">Hi Ishita</div><div dir="auto" class=""><br class=""></div><div dir="auto" class="">I have successfully served 30MB files in my deployment.</div><div dir="auto" class=""><br class=""></div><div dir="auto" class="">This might be a bug on segmentation, instead of a bug related to large file size. 1KB, 10KB, 100KB are not multiply of 8KB.</div><div dir="auto" class="">If my hypothesis is true, you should see this problem with exact 8KB, 16KB, 24KB files; this problem should disappear if you add 1 byte after an 1MB or 100MB file.</div><div dir="auto" class="">Can you try those sizes and report back?</div><div dir="auto" class=""><br class=""></div><div dir="auto" class="">Yours, Junxiao</div><br class=""><div class="gmail_quote"><div class=""><div class="m_2535641639596162498m_-6880241115454691203h5"><div class="">On Sat, Jul 15, 2017 at 09:33 Ishita Dasgupta <<a href="mailto:ishita.dasgupta@gmail.com" target="_blank" class="">ishita.dasgupta@gmail.com</a>> wrote:<br class=""></div></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class=""><div class="m_2535641639596162498m_-6880241115454691203h5"><div class=""><div class="gmail_default" style="font-family:tahoma,sans-serif">Hi All, </div><div class="gmail_default" style="font-family:tahoma,sans-serif"><br class=""></div><div class="gmail_default" style="font-family:tahoma,sans-serif">I am trying to study performance of file download over ndn across different file sizes. </div><div class="gmail_default" style="font-family:tahoma,sans-serif">I am using ndnfs-port server to do the same, but I am receiving weird anomaly for file sizes > 1 MB. </div><div class="gmail_default"><font face="tahoma, sans-serif" class="">It works fine for file sizes of 1KB,10KB and 100KB, but when it comes to 1MB or greater, the </font>ndnfs<font face="tahoma, sans-serif" class=""> server application gives the following debug log for the last segment for each of these files </font></div><div class="gmail_default"><font face="tahoma, sans-serif" class=""><br class=""></font></div><div class="gmail_default">
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><font size="1" class=""><span class="m_2535641639596162498m_-6880241115454691203m_5153166337964205196m_-3629553672371713666gmail-s1">- 1500131726 DEBUG: sign_segment: path=/1MB.txt, ver=1500131708, seg=127, len=8192<br class=""></span><span class="m_2535641639596162498m_-6880241115454691203m_5153166337964205196m_-3629553672371713666gmail-s1">- 1500131726 DEBUG: sign_segment: segment name is /ndn/broadcast/ndnfs/1MB.txt/%<wbr class="">FDYj1%7C/%00%7F<br class=""></span><span class="m_2535641639596162498m_-6880241115454691203m_5153166337964205196m_-3629553672371713666gmail-s1">- 1500131726 DEBUG: sign_segment: path=/1MB.txt, ver=1500131708, seg=128, len=0<br class=""></span><span class="m_2535641639596162498m_-6880241115454691203m_5153166337964205196m_-3629553672371713666gmail-s1">- 1500131726 DEBUG: sign_segment: segment name is /ndn/broadcast/ndnfs/1MB.txt/%<wbr class="">FDYj1%7C/%00%80</span></font></blockquote><div class=""> <br class=""></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><span style="background-color:rgb(255,255,255)" class=""><font size="1" class=""><span class="m_2535641639596162498m_-6880241115454691203m_5153166337964205196m_-3629553672371713666gmail-s1"><font face="arial, helvetica, sans-serif" class="">- 1499891047 DEBUG: sign_segment: path=/10MB.txt, ver=1499890866, seg=1279, len=8192<br class=""></font></span><span class="m_2535641639596162498m_-6880241115454691203m_5153166337964205196m_-3629553672371713666gmail-s1"><font face="arial, helvetica, sans-serif" class="">- 1499891047 DEBUG: sign_segment: segment name is /ndn/broadcast/ndnfs/10MB.txt/<wbr class="">%FDYf%84%B2/%00%04%FF<br class=""></font></span><span class="m_2535641639596162498m_-6880241115454691203m_5153166337964205196m_-3629553672371713666gmail-s1"><font face="arial, helvetica, sans-serif" class="">- 1499891047 DEBUG: sign_segment: path=/10MB.txt, ver=1499890866, seg=1280, len=0<br class=""></font></span><font face="arial, helvetica, sans-serif" class=""><span style="font-variant-ligatures:no-common-ligatures" class="">- 1499891047 DEBUG: sign_segment: segment name is /ndn/broadcast/ndnfs/10MB.txt/<wbr class="">%FDYf%84%B2/%00%05%00</span> </font></font></span></blockquote><div class=""><br class=""></div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><font style="background-color:rgb(255,255,255)" class=""><span class="m_2535641639596162498m_-6880241115454691203m_5153166337964205196m_-3629553672371713666gmail-s1"><font size="1" face="arial, helvetica, sans-serif" class="">- 1499893665 DEBUG: sign_segment: path=/100MB.txt, ver=1499892176, seg=12799, len=8192<br class=""></font></span><span class="m_2535641639596162498m_-6880241115454691203m_5153166337964205196m_-3629553672371713666gmail-s1"><font size="1" face="arial, helvetica, sans-serif" class="">- 1499893665 DEBUG: sign_segment: segment name is /ndn/broadcast/ndnfs/100MB.txt<wbr class="">/%FDYf%89%D0/%001%FF<br class=""></font></span><span class="m_2535641639596162498m_-6880241115454691203m_5153166337964205196m_-3629553672371713666gmail-s1"><font size="1" face="arial, helvetica, sans-serif" class="">- 1499893665 DEBUG: sign_segment: path=/100MB.txt, ver=1499892176, seg=12800, len=0<br class=""></font></span><font size="1" face="arial, helvetica, sans-serif" class=""><span style="font-variant-ligatures:no-common-ligatures" class="">- 1499893665 DEBUG: sign_segment: segment name is /ndn/broadcast/ndnfs/100MB.txt<wbr class="">/%FDYf%89%D0/%002%00</span> </font></font></blockquote>
</div><div class="gmail_default"><font style="background-color:rgb(255,255,255)" size="1" face="tahoma, sans-serif" class=""><br class=""></font></div><div class="gmail_default"><font style="background-color:rgb(255,255,255)" size="1" face="tahoma, sans-serif" class=""><br class=""></font></div><div class="gmail_default"><font face="tahoma, sans-serif" class=""><span style="background-color:rgb(255,255,255)" class=""><font size="1" class="">T</font></span>his further causes </font><span style="background-color:transparent;white-space:pre-wrap" class=""><font color="#cc0000" face="tahoma, sans-serif" class=""><i class="">“File empty” for the last data packet when using PyNDN client</i></font></span><font face="tahoma, sans-serif" class=""><i class=""><font color="#cc0000" class="">.</font></i><font color="rgba(0, 0, 0, 0)" class=""> </font><font class="">The client works fine as long as the last segment (data packet) size on the server is not 0. </font></font></div><div class="gmail_default" style="font-family:tahoma,sans-serif"><br class=""></div><div class="gmail_default" style="font-family:tahoma,sans-serif">Does anyone have any clue as to why this might be happening? Could this be a problem with the files itself? I know ndnfs-port fixes file segment sizes to 8KB, but I couldn't find any explanation that would suggest that it has a size limit when it comes to file download.</div><div class=""><div class="m_2535641639596162498m_-6880241115454691203m_5153166337964205196m_-3629553672371713666gmail_signature"><div class=""><div class=""><div class=""></div></div></div></div></div>
</div></div></div>
______________________________<wbr class="">_________________<br class="">
Ndn-interest mailing list<br class="">
<a href="mailto:Ndn-interest@lists.cs.ucla.edu" target="_blank" class="">Ndn-interest@lists.cs.ucla.edu</a><br class="">
<a href="http://www.lists.cs.ucla.edu/mailman/listinfo/ndn-interest" rel="noreferrer" target="_blank" class="">http://www.lists.cs.ucla.edu/m<wbr class="">ailman/listinfo/ndn-interest</a><br class="">
</blockquote></div></div>
</blockquote></div><br class=""></div></div></div></div>
</blockquote></div><br class=""></div>
_______________________________________________<br class="">Ndn-interest mailing list<br class=""><a href="mailto:Ndn-interest@lists.cs.ucla.edu" class="">Ndn-interest@lists.cs.ucla.edu</a><br class="">http://www.lists.cs.ucla.edu/mailman/listinfo/ndn-interest<br class=""></div></blockquote></div><br class=""></div></div></div></body></html>