Best Track Data

This section will discuss the process of downloading and loading Best Track data both from JMA and IBTrACS.

Downloading

To download the JMA Best Track data, simply run the following:

julia> using Bagyo
julia> get(BestTrack, :jma)┌ Info: Downloading
│   source = "https://www.jma.go.jp/jma/jma-eng/jma-center/rsmc-hp-pub-eg/Besttracks/bst_all.zip"
│   dest = "/home/runner/work/Bagyo.jl/Bagyo.jl/src/../db/jma/bt/bst_all.zip"
│   progress = 1.0
│   time_taken = "0.07 s"
│   time_remaining = "0.0 s"
│   average_speed = "9.530 MiB/s"
│   downloaded = "722.181 KiB"
│   remaining = "0 bytes"
└   total = "722.181 KiB"
[ Info: Unzipping file
[ Info: Zip file path /home/runner/work/Bagyo.jl/Bagyo.jl/src/../db/jma/bt/bst_all.txt
[ Info: Deleting zip file
[ Info: Parsing raw data
[ Info: Saving cleaned data
"/home/runner/work/Bagyo.jl/Bagyo.jl/src/../db/jma/bt/track_data.csv"

As for IBTrACS, replace :jma with :ibtracs:

julia> get(BestTrack, :ibtracs)┌ Info: Downloading
│   source = "https://www.ncei.noaa.gov/data/international-best-track-archive-for-climate-stewardship-ibtracs/v04r00/access/csv/ibtracs.WP.list.v04r00.csv"
│   dest = "/home/runner/work/Bagyo.jl/Bagyo.jl/src/../db/ibtracs/bt/bst_all.csv"
│   progress = 0.1295
│   time_taken = "1.05 s"
│   time_remaining = "7.03 s"
│   average_speed = "12.952 MiB/s"
│   downloaded = "13.548 MiB"
│   remaining = "91.046 MiB"
└   total = "104.594 MiB"
┌ Info: Downloading
│   source = "https://www.ncei.noaa.gov/data/international-best-track-archive-for-climate-stewardship-ibtracs/v04r00/access/csv/ibtracs.WP.list.v04r00.csv"
│   dest = "/home/runner/work/Bagyo.jl/Bagyo.jl/src/../db/ibtracs/bt/bst_all.csv"
│   progress = 0.3693
│   time_taken = "2.06 s"
│   time_remaining = "3.51 s"
│   average_speed = "18.776 MiB/s"
│   downloaded = "38.622 MiB"
│   remaining = "65.972 MiB"
└   total = "104.594 MiB"
┌ Info: Downloading
│   source = "https://www.ncei.noaa.gov/data/international-best-track-archive-for-climate-stewardship-ibtracs/v04r00/access/csv/ibtracs.WP.list.v04r00.csv"
│   dest = "/home/runner/work/Bagyo.jl/Bagyo.jl/src/../db/ibtracs/bt/bst_all.csv"
│   progress = 0.6999
│   time_taken = "3.06 s"
│   time_remaining = "1.31 s"
│   average_speed = "23.937 MiB/s"
│   downloaded = "73.200 MiB"
│   remaining = "31.394 MiB"
└   total = "104.594 MiB"
┌ Info: Downloading
│   source = "https://www.ncei.noaa.gov/data/international-best-track-archive-for-climate-stewardship-ibtracs/v04r00/access/csv/ibtracs.WP.list.v04r00.csv"
│   dest = "/home/runner/work/Bagyo.jl/Bagyo.jl/src/../db/ibtracs/bt/bst_all.csv"
│   progress = 1.0
│   time_taken = "3.97 s"
│   time_remaining = "0.0 s"
│   average_speed = "26.326 MiB/s"
│   downloaded = "104.594 MiB"
│   remaining = "0 bytes"
└   total = "104.594 MiB"
"/home/runner/work/Bagyo.jl/Bagyo.jl/src/../db/ibtracs/bt/bst_all.csv"

Bagyo.jl only downloads the Western-North Pacific data of IBTrACS.

Loading

To load the JMA Best Track data, run the following:

julia> meta, data = load(BestTrack, :jma);
julia> meta1856×7 DataFrame
  Row │ INTERNATIONAL_ID  NUMBER_OF_LINES  CYCLONE_NUMBER  LAST_FLAG  TIME_DIF ⋯
      │ Int64             Int64            Int64?          Int64      Missing  ⋯
──────┼─────────────────────────────────────────────────────────────────────────
    1 │             5101               10         missing          0    missin ⋯
    2 │             5102               37         missing          0    missin
    3 │             5103               36         missing          0    missin
    4 │             5104               66         missing          0    missin
    5 │             5105               45         missing          1    missin ⋯
    6 │             5106               29         missing          0    missin
    7 │             5107               34         missing          1    missin
    8 │             5108               17         missing          0    missin
  ⋮   │        ⋮                 ⋮               ⋮             ⋮          ⋮    ⋱
 1850 │             2116               57              23          1    missin ⋯
 1851 │             2117               24              24          0    missin
 1852 │             2118               31              25          0    missin
 1853 │             2119               42              26          1    missin
 1854 │             2120               39              27          1    missin ⋯
 1855 │             2121               23              28          0    missin
 1856 │             2122               39              29          0    missin
                                                 3 columns and 1841 rows omitted
julia> data67891×19 DataFrame
   Row │ INTERNATIONAL_ID  DATE_TIME            YEAR   MONTH  DAY    HOUR   ST ⋯
       │ Int64             DateTime             Int64  Int64  Int64  Int64  St ⋯
───────┼────────────────────────────────────────────────────────────────────────
     1 │             5101  1951-02-19T06:00:00   1951      2     19      6  mi ⋯
     2 │             5101  1951-02-19T12:00:00   1951      2     19     12  mi
     3 │             5101  1951-02-19T18:00:00   1951      2     19     18  mi
     4 │             5101  1951-02-20T00:00:00   1951      2     20      0  mi
     5 │             5101  1951-02-20T06:00:00   1951      2     20      6  mi ⋯
     6 │             5101  1951-02-20T12:00:00   1951      2     20     12  mi
     7 │             5101  1951-02-20T18:00:00   1951      2     20     18  mi
     8 │             5101  1951-02-21T00:00:00   1951      2     21      0  mi
   ⋮   │        ⋮                   ⋮             ⋮      ⋮      ⋮      ⋮       ⋱
 67885 │             2122  2021-12-19T18:00:00   2021     12     19     18  RA ⋯
 67886 │             2122  2021-12-20T00:00:00   2021     12     20      0  RA
 67887 │             2122  2021-12-20T06:00:00   2021     12     20      6  RA
 67888 │             2122  2021-12-20T12:00:00   2021     12     20     12  RA
 67889 │             2122  2021-12-20T18:00:00   2021     12     20     18  RA ⋯
 67890 │             2122  2021-12-21T00:00:00   2021     12     21      0  RA
 67891 │             2122  2021-12-21T06:00:00   2021     12     21      6  RA
                                               13 columns and 67876 rows omitted

Note that JMA returns two datasets, the metadata which contains the information about the storm, and the corresponding data of the storm tracks. For the description of the columns, please refer to JMA documentation.

As for IBTrACS, there is only one data containing all the information about the cyclone.

julia> data = load(BestTrack, :ibtracs);
julia> data240845×163 DataFrame
    Row │ SID            SEASON  NUMBER  BASIN    SUBBASIN  NAME       ISO_TIM ⋯
        │ String15       Int64   Int64   String3  String3   String31   String3 ⋯
────────┼───────────────────────────────────────────────────────────────────────
      1 │ 1884177N17124    1884      14  WP       MM        NOT_NAMED  1884-06 ⋯
      2 │ 1884177N17124    1884      14  WP       MM        NOT_NAMED  1884-06
      3 │ 1884177N17124    1884      14  WP       MM        NOT_NAMED  1884-06
      4 │ 1884177N17124    1884      14  WP       MM        NOT_NAMED  1884-06
      5 │ 1884177N17124    1884      14  WP       MM        NOT_NAMED  1884-06 ⋯
      6 │ 1884177N17124    1884      14  WP       MM        NOT_NAMED  1884-06
      7 │ 1884177N17124    1884      14  WP       MM        NOT_NAMED  1884-06
      8 │ 1884177N17124    1884      14  WP       MM        NOT_NAMED  1884-06
   ⋮    │       ⋮          ⋮       ⋮        ⋮        ⋮          ⋮              ⋱
 240839 │ 2022099N11127    2022      23  WP       MM        MEGI       2022-04 ⋯
 240840 │ 2022099N11127    2022      23  WP       MM        MEGI       2022-04
 240841 │ 2022099N11127    2022      23  WP       MM        MEGI       2022-04
 240842 │ 2022099N11127    2022      23  WP       MM        MEGI       2022-04
 240843 │ 2022099N11127    2022      23  WP       MM        MEGI       2022-04 ⋯
 240844 │ 2022099N11127    2022      23  WP       MM        MEGI       2022-04
 240845 │ 2022099N11127    2022      23  WP       MM        MEGI       2022-04
                                             157 columns and 240830 rows omitted

Please refer to IBTrACS documentation for the description of the columns of the data above.

Deleting

The downloaded data are saved in the local directory of your machine, and the following APIs helps on managing this data, in particular for deleting the said data.

julia> # delete only the Best Track of JMA Data
       delete!(BestTrack, :jma)[ Info: JMA Best Track DB successfully deleted.
julia> # delete all JMA Data folders and files
       delete!(:jma)[ Info: JMA DB successfully deleted.

For IBTrACS,

julia> # delete only the Best Track of IBTrACS Data
       delete!(BestTrack, :ibtracs)[ Info: IBTrACS Best Track DB successfully deleted.
julia> # delete all IBTrACS Data folders and files
       delete!(:ibtracs)[ Info: IBTrACS DB successfully deleted.