Maggie-NS Tasklist

 

October 5, 2004

 

NEXT MEETING: October 6, 2004

Awaits something, also provides start of wait date

{Done or Drop. Is deleted 2 months after task finished or dropped}

– Person doing the work

Bold face - task in progress, or for discussion at meeting

Highlights are recent developments

 

Action Items   

1. PingER –SLAC contact: Jerrod

1. Provide tools to analyze and create plots of PingER data - Jerrod, Usman Ahmad Mian [ahmed.usman@niit.edu.pk]

   1. Long term exponential fits, aggregation by region, etc.

   2. Number of hosts with loss qualities

   3. Tie into webservices/SQL access to data to make a much more flexible distributed way of selecting analyzing and displaying data

   4. This is to be done using Perl scripts/GnuPlot flat files, etc.

   5. The algorithm to get the data has been written and implemented for this and is currently being tested. Now working on generating graphs. Ahmad will provide SLAC with  prototype plots of this in the coming days (9/23/04)  - Ahmad Usman

      1. Resolve what to do with missing data

      2. Take medians not averages

      3. How to get summary data

   6. Understand project, develop tool to gather data - NIIT (5/26/04 - in progress.)

      1. Early stages of the graphs were good. Looking to improve on them to get to production quality.
      2. Jerrod will work with Nazir to get an account at SLAC. (6/09/04 - in progress. Requires Nazir to fill out one additional form which has been emailed to him for completion.)
   7. Fix bug that causes Oct 2000 to be displayed twice in allmonths (Ashar will work around, Jerrod has looked at but does not see the cause 9/23/04) - Jerrod
2. Develop a package to make PingER installs of “monitoring sites” a simpler process.
   1. Set up a website for PingER (would need very close collaboration with SLAC, possibly once a student has arrived at SLAC)
   2. Extend Pinger Gathering to make it hourly so data is more “real-time” (in progresss)  - Nazir, Jiri
      1. Plans are for NIIT to download PingER historical data once a week (or so) and test their tools against downloaded data.  This practice mirrors SLAC running the tools in-house similar to how the tools will be used once in production.  
   3. Extend Pingtable to enable access to long-term data (5 years) for PingER {Done 5/6/04} - Jerrod
3. Convert offsite.nodes to a database format
4. Extend plot-lat/long (see http://www.caida.org/tools/visualization/plot-latlong/index.xml) to provide support for different symbols other than circles, mouseover, as well as making the image clickable with URLs to sites to be determined later. (Nazir)  No need to continue with this, Sufyan has provided plots.pl which facilitates mouseover, zooming, etc. (9/23/04)
   1. Write Perl script to read Guthrie data and provide mouse sensitive map with mouseover providing the name of the site, and mouse click going to the URL provided by Guthrie {Done 5/6/04} - Nazir
   2. Install new version of PingER maps at SLAC (9/23/04 awaits Sufyan examining the out-of-range coordinates) {Fixed 10/20/04} - Jerrod
   3. Extend to ABwE and IEPM data  - Connie
   4. Provide "zoom" type capability to allow selection between closely spaced hosts - Sufyan
      1. Provide capability to minimize dots on the graph once the user zooms in (done 6/9/04)
      2. Provide Jerrod with the executables to run the zooming graphs for install at SLAC - Sufyan (6/9/04)
   5. Look at providing a GUI to enter location data - Nazir (done 6/9/04)
      1. Work on interfacing the current GUI with our guthrie database to allow entries to automatically be entered into the current listings. This will be done once we be worked on either once we get Nazir a SLAC account or once he reports to SLAC later on this Fall. (6/9/04)
   6. Add ping times etc. - Jerrod (6/9/04 - in progress.  Jerrod will add a GMT field to the guthrie database and fill in the GMT offsets for each node. Promised response by early next week.)
5. Pingtable.pl
   1. Provide ability to only view hosts with substantial amounts of data {Done 6/25/04} - Jerrod
   2. Review PingER2 and see how to incorporate
      1. Request & get tar ball from Warren (virus checker removes tar ball from mail, 5/16/04, got via anon FTP) - Les
      2. Install and check out - Warren
   3. Provide machine readable access to monitoring host participants etc. - Maxim
   4. Make pingtable.pl available by FTP (Raja is testing 8/3/04) {Get data from web instead - 9/22/04} - Jerrod, Les
   5. Provide ability to select hosts and provide time series + percentiles (currently a stand-alone, will make web accessible, 9/23/04) - ashar
6. Web services access to Guthrie - Jerrod
   1. Fix bug in locations.txt work-around that causes multiple values (spotted by Fawad) for apan.net (2) and riken.go.jp (9) - Jerrod
   2. Fawad reports there are still duplicates 10/20/04 - Jerrod
   3. Missing data in locations.txt (Fawad will work around, Jerrod will see if Fawad can update the Guthrie database himself to add the missing information 9/23/04) - Fawad, Jerrod
7. NDT –SLAC contact: Connie
   1. Install Web100 {Done} - Ashar
   2. Work with Richard Carlson on developing NDT
   3. Install NDT server at NIIT {Done 4/31/04} - NIIT
   4. Provide a command-line interface to the NDT package to provide continual data from NDT and not just gather data when a user goes to te NDT web site. {Done} - Rich Carlson
   5. Evaluate new version of NDT, especially the CLI to launch test from a remote site to the NDT server at NIIT {Done 5/6/04} - NIIT
   6. Report local loop bug to Carlson {Done 5/6/04}
   7. Next steps will be to use it following detection of an "event" to gather more information on the problem
   8. Try out NIIT Java client - Fahad, Les, Paola, (6/9/04 -in progress. )
8. NETRAT –SLAC contact: Connie
   1. Work on change detection and alerting of changes in the network performance (good idea for a summer project then carry back to NIIT)
      1. Strictly a research based project, not guarantee of a product
      2. Distribute multivariate paper {Done 4/27/04} - Les
      3. Identify student with required skills statistics, math ... - Arshad
      4. Evaluate the PCA multivariate method of Crovella - (9/23/04 Azam/Arshad Ali)
         1. Prof. Arshad has two prospective students in mind whom he will interview in the coming days. Once he finds a suitable candidate, he will inform Les {have students}
         2. Get algorithm working
         3. Try it out with SLAC data
         4. Compare with alternative techniques
9. Add to the detection of network problems the gathering of relevant info. For the complete path.  The idea is that along with the alerts, we provide a bit of diagnostics to present to the sites seeing problems so that we don’t just send messages reporting the problem but provide info that could help them solve the problem as well. - Fahad Khalid
   1.  Filter alerts before reporting
   2. Write paper for PAM05 (deadline for extended abstract (4 pages) is October 15
10. Convert AMP data to form suitable for traceanal, triganal or mod scripts to accept AMP data - Connie
    1. Understand AMP data & document task (awaits Connie)
    2. Understand traceanal and use to analyze AMP data
       1. Document traceanal - ?
       2. Use traceanal to analyze and display AMP traceroute data - ?
    1. Provide sources of triganal & traceanal to NIIT
       1. Produce some documentation - Jerrod, Les
11. IEPM-LITE –SLAC contact: Connie
    1. Re-architect IEPM-LITE to make it more portable  - Connie (5/26/04 - in progress.)
       1. Once the redesign is completed, Connie needs to have a few cgi scripts written to facilitate adding nodes to the IEPM-LITE tests.
    2. Complete a distribution kit for Iepm-Lite.  (Jerrod)
    3. Generate ABWE's config. file from bandsrc/slaconly/aliases.  Include with this the ability to automatically detect/reload a more current version of the config. file.  (Jiri)
    4. Package ABWE for distribution. NEEDED: a way to run ABWE every 5mins using gnuplot.
    5. Send NIIT the structure for building an Oracle database to handle the IEPM-LITE data
    6. Install Iepm-Lite at NIIT -Done up to ABWE {Done 4-27-03}
    7. Write a new parallel traceroute, send probes (ICMP or UDP selectable) in parallel to different TTLs. (Nazir)
       1. Decide nanog-traceroute is adequate {Done  5/6/04}- all
12. Webpage – Mati
    1. Add links on the “Tools” page to the documentation of the various packages we discuss and develop
    2. Create link that outlines who is working on what projects at a given time.
    3. Develop a “Task List” ” where we keep track of what is in progress, who is working on what, and what has been accomplished. This will facilitate tracking our progress, and writing a required “Status Reports” for the funding agencies.  SLAC will generate one for starters and send it out to NIIT {Done you are looking at the Task list} - Jerrod, Les.
    4. Create a link to the meeting’s minutes rather than sending them for download {Done 5/11/04}
    5. Register  IP address (202.83.166.170) with DNS name server - Nazir {Done 5/26/04}
    6. Add pictures of group members to the Maggie-NS website. (6/9/04 - in progress.)
       1. SLAC group members will provide NIIT with our pictures by the next meeting to be placed on the website {Done 7/9/04}.  (6/9/04 - jerrod)
       2. SLAC members need to provide bio details
13. Jiris Nearest Abroad Neighbor Fawad, Jiri
    1. Specify what the result might look like for a couple of sites - Jiri
    2. Provide table for each monitoring host, for each remote host, by TLD, add extra metrics (min, avg, std, distance (identify distance as great-circle route) etc.) - Fawad
    3. Provide a way to read PingER data from monitoring sites in near-real time - Jerrod, NIIT
    4. Add traceroute measurements to PingER monitoring sites - Jerrod
    5. Provide country information on hosts - Les, Jerrod
14. Communications
    1. Set up archive for email list (in progress 5/11/04) - Fahad Khalid  (5/26/04 -in progress.  Researching possibly using YAHOO groups for archiving email lists.)
       1. Sys admin at NIIT has set up an archived moderated list at maggie-niit@ns.niit.edu.pk and the archive is available at: http://ns.niit.edu.pk/pipermail/maggie-niit/ {Done 10/20/04} - Sysadmin at NIIT.
       2. Add link to archive from the http://maggie.niit.edu.pk/ site - Mati-Ur-Rehman
       3. Improve the reliability of the maggie web site at http://maggie.niit.edu.pk/