[Mini-NDN] [EXT]Re: Issue with publishing multiple video files

[Junxiao Shi]

Hi Ritu

repo-ng is deprecated. Do not use!

Try either of these:
https://www.npmjs.com/package/@ndn/repo-cli
https://pypi.org/project/ndn-python-repo/

Yours, Junxiao

On Fri, Sep 11, 2020 at 01:44 Ritu Bordoloi <bordoloi.ritu1988 at gmail.com>
wrote:

> *External Email*
> Dear Alex and Junxiao,
>
> Thank you for your reply. It seems that it is a memory issue, as I can
> publish small size videos without any issue.
>
> As for the repo, I can see two repo packages
> https://github.com/named-data/repo-ng and
> https://github.com/JonnyKong/ndn-python-repo. I tried to install
> https://github.com/named-data/repo-ng. However, I was getting the
> following error.
>
> Waf: Entering directory `/home/ritu/Downloads/repo-ng-master/build'
> [ 2/20] Compiling src/handles/read-handle.cpp
> [ 3/20] Compiling src/repo-command-parameter.cpp
> In file included from ../src/handles/read-handle.hpp:23:0,
>                  from ../src/handles/read-handle.cpp:20:
> ../src/common.hpp:31:10: fatal error: ndn-cxx/security/validator.hpp: No
> such file or directory
>  #include <ndn-cxx/security/validator.hpp>
>           ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> compilation terminated.
> Waf: Leaving directory `/home/ritu/Downloads/repo-ng-master/build'
> Build failed
>  -> task in 'repo-objects' failed with exit status 1 (run with -v to
> display more information)
>
> Can someone give me any idea on this?
>
> Thank you in advance.
>
> Kind regards,
> Ritu
>
>
> On Thu, 10 Sep 2020, 9:55 am Junxiao Shi, <shijunxiao at email.arizona.edu>
> wrote:
>
>> Hi Ritu Bordoloi
>>
>> ndnputchunks is known to consume large amount of memory when publishing a
>> large file. The main reason is that it must buffer all Data packets in
>> memory.
>> For a 300MB file, you can expect 1GB memory usage.
>> https://redmine.named-data.net/issues/4866
>> If you do not have sufficient memory, publishing will either fail or take
>> a very long time due to usage of swapfile.
>>
>> If you just want a producer that publishes files, but do not require all
>> Data packets to be buffered in memory, consider using a repository service.
>> For command line use, try ndn-python-repo
>> <https://github.com/JonnyKong/ndn-python-repo> (Python).
>> For programmatic/API use, try @ndn/repo package
>> <https://ndnts-docs.ndn.today/typedoc/modules/repo.html> (Node.js).
>> Note that repo-ng is deprecated and should not be used in new
>> applications.
>>
>> Yours, Junxiao
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.lists.cs.ucla.edu/pipermail/mini-ndn/attachments/20200911/a4f4897f/attachment.html>