[Mini-NDN] [EXT]Re: Generate large amounts of video files traffic in Mini-NDN

[Junxiao Shi]

Dear folks

Thanks for the mention.
Yes, I operate https://pushups.ndn.today , the largest video website on the
NDN network.
The server component is https://github.com/yoursunny/NDNts-video-server .

It is possible to connect a server into an NFD/YaNFD instance running in a
Mininet container.
Specifically, you'll want to make the server connect to the Unix socket of
NFD/YaNFD, by putting the Unix socket address in .env file, like this:
NDNTS_UPLINK=unix:///run/nfd.sock
It is unnecessary to obtain certificates in this setup.

The client component relies on Shaka Player, and it can only run in a real
browser.
It isn't possible to run the client in Mininet container.

@FAT32 on LowEndTalk community made a script that re-exports NDN network as
an HTTP server, and then calls youtube-dl to download a video.
https://www.lowendtalk.com/discussion/comment/3236214/#Comment_3236214
You may be able to adapt his script so that it connects to an NFD/YaNFD
instance instead of the testbed, and then call youtube-dl in the same way.
However, the traffic pattern of video downloading differs from video
streaming.


Regarding ndnputhunks: one caveat of this app is that, it will buffer all
packets in memory. If you serve a 1GB file, it consumes more than 1GB RAM.
I have an alternative ndn6-file-server in
https://github.com/yoursunny/ndn6-tools .
It can serve a folder of files. It generates each packet on demand when an
Interest arrives, but does not buffer any packet. Thus, it's able to serve
files larger than your memory, but it's slower than ndnputchunks for
answering each Interest.
However, you can't write to the folder when ndn6-file-server is serving, or
the program could crash.

Yours, Junxiao

On Thu, Jul 29, 2021, 20:11 Philipp Moll <phmoll at cs.ucla.edu> wrote:

> *External Email*
>
> Hi Jiacheng,
>
> Thanks for dropping a message. In MiniNDN, you can basically use any
> headless NDN application you want. MiniNDN just starts the application
> using a bash-command. But I think answering your question becomes easier
> when knowing more details about what you want to achieve. Publishing and
> retrieving large video files could be interpreted in many ways.
>
> If you simply want to handle those large video files as large files, we
> have tools like ndncatchunks and ndnputchunks to publish/consume files from
> the file system:
> https://github.com/named-data/ndn-tools/tree/master/tools/chunks
>
> When you want to emulate something like Dynamic Adaptive Streaming over
> MiniNDN, it might be good to use something like a DAS dataset that already
> has pre-computed video-segments (here's one example dataset:
> https://dash.itec.aau.at/dash-dataset/). To retrieve these segments, you
> might use emulated video streaming clients that retrieve the pre-computed
> segments based on some adaption logic..
>
> Junxiao did some recent work on video streaming. He has streaming
> publishers and clients available for TypeScript. See here:
> https://github.com/yoursunny/NDNts-video
>
> Without having tried, but since those are TypeScript clients, they should
> also work in MiniNDN. At least the producer should run, and maybe Junxiao
> also has a headless consumer that can be used with MiniNDN.
>
> But as I said first, it really depends on what you want to do.
>
> Best,
> Philipp
> On 7/29/21 4:26 PM, JIACHENG HOU via Mini-NDN wrote:
>
> Hi, Mini-NDN teams,
>
>
>
> Before I tried generating a bunch of traffic using ndn-traffic-generator.
> However, it seems that the ndn-traffic-generator is not suitable for
> publishing and retrieving large video files.
>
>
>
> I am wondering are there any recommended tools to generate a lot of
> traffic for video files in Mini-NDN?
>
>
>
> Thanks for your help.
>
>
>
> Best wishes,
>
> Jiacheng
>
> _______________________________________________
> Mini-NDN mailing listMini-NDN at lists.cs.ucla.eduhttp://www.lists.cs.ucla.edu/mailman/listinfo/mini-ndn
>
> _______________________________________________
> Mini-NDN mailing list
> Mini-NDN at lists.cs.ucla.edu
> http://www.lists.cs.ucla.edu/mailman/listinfo/mini-ndn
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.lists.cs.ucla.edu/pipermail/mini-ndn/attachments/20210730/d36c836a/attachment.html>