Best Track Data

This section will discuss the process of downloading and loading Best Track data both from JMA and IBTrACS.

Downloading

To download the JMA Best Track data, simply run the following:

julia> using Bagyo
julia> get(BestTrack, :jma)┌ Info: Downloading │ source = "https://www.jma.go.jp/jma/jma-eng/jma-center/rsmc-hp-pub-eg/Besttracks/bst_all.zip" │ dest = "/home/runner/work/Bagyo.jl/Bagyo.jl/src/../db/jma/bt/bst_all.zip" │ progress = 1.0 │ time_taken = "0.11 s" │ time_remaining = "0.0 s" │ average_speed = "6.653 MiB/s" │ downloaded = "722.181 KiB" │ remaining = "0 bytes" └ total = "722.181 KiB" [ Info: Unzipping file [ Info: Zip file path /home/runner/work/Bagyo.jl/Bagyo.jl/src/../db/jma/bt/bst_all.txt [ Info: Deleting zip file [ Info: Parsing raw data [ Info: Saving cleaned data "/home/runner/work/Bagyo.jl/Bagyo.jl/src/../db/jma/bt/track_data.csv"

As for IBTrACS, replace :jma with :ibtracs:

julia> get(BestTrack, :ibtracs)┌ Info: Downloading
│   source = "https://www.ncei.noaa.gov/data/international-best-track-archive-for-climate-stewardship-ibtracs/v04r00/access/csv/ibtracs.WP.list.v04r00.csv"
│   dest = "/home/runner/work/Bagyo.jl/Bagyo.jl/src/../db/ibtracs/bt/bst_all.csv"
│   progress = 0.2774
│   time_taken = "1.0 s"
│   time_remaining = "2.61 s"
│   average_speed = "28.983 MiB/s"
│   downloaded = "29.012 MiB"
│   remaining = "75.582 MiB"
└   total = "104.594 MiB"
┌ Info: Downloading
│   source = "https://www.ncei.noaa.gov/data/international-best-track-archive-for-climate-stewardship-ibtracs/v04r00/access/csv/ibtracs.WP.list.v04r00.csv"
│   dest = "/home/runner/work/Bagyo.jl/Bagyo.jl/src/../db/ibtracs/bt/bst_all.csv"
│   progress = 0.7574
│   time_taken = "2.0 s"
│   time_remaining = "0.64 s"
│   average_speed = "39.569 MiB/s"
│   downloaded = "79.216 MiB"
│   remaining = "25.377 MiB"
└   total = "104.594 MiB"
┌ Info: Downloading
│   source = "https://www.ncei.noaa.gov/data/international-best-track-archive-for-climate-stewardship-ibtracs/v04r00/access/csv/ibtracs.WP.list.v04r00.csv"
│   dest = "/home/runner/work/Bagyo.jl/Bagyo.jl/src/../db/ibtracs/bt/bst_all.csv"
│   progress = 1.0
│   time_taken = "2.53 s"
│   time_remaining = "0.0 s"
│   average_speed = "41.325 MiB/s"
│   downloaded = "104.594 MiB"
│   remaining = "0 bytes"
└   total = "104.594 MiB"
"/home/runner/work/Bagyo.jl/Bagyo.jl/src/../db/ibtracs/bt/bst_all.csv"

Bagyo.jl only downloads the Western-North Pacific data of IBTrACS.

Loading

To load the JMA Best Track data, run the following:

julia> meta, data = load(BestTrack, :jma);
julia> meta1856×7 DataFrame Row │ INTERNATIONAL_ID NUMBER_OF_LINES CYCLONE_NUMBER LAST_FLAG TIME_DIF ⋯ │ Int64 Int64 Int64? Int64 Missing ⋯ ──────┼───────────────────────────────────────────────────────────────────────── 1 │ 5101 10 missing 0 missin ⋯ 2 │ 5102 37 missing 0 missin 3 │ 5103 36 missing 0 missin 4 │ 5104 66 missing 0 missin 5 │ 5105 45 missing 1 missin ⋯ 6 │ 5106 29 missing 0 missin 7 │ 5107 34 missing 1 missin 8 │ 5108 17 missing 0 missin ⋮ │ ⋮ ⋮ ⋮ ⋮ ⋮ ⋱ 1850 │ 2116 57 23 1 missin ⋯ 1851 │ 2117 24 24 0 missin 1852 │ 2118 31 25 0 missin 1853 │ 2119 42 26 1 missin 1854 │ 2120 39 27 1 missin ⋯ 1855 │ 2121 23 28 0 missin 1856 │ 2122 39 29 0 missin 3 columns and 1841 rows omitted
julia> data67891×19 DataFrame Row │ INTERNATIONAL_ID DATE_TIME YEAR MONTH DAY HOUR ST ⋯ │ Int64 DateTime Int64 Int64 Int64 Int64 St ⋯ ───────┼──────────────────────────────────────────────────────────────────────── 1 │ 5101 1951-02-19T06:00:00 1951 2 19 6 mi ⋯ 2 │ 5101 1951-02-19T12:00:00 1951 2 19 12 mi 3 │ 5101 1951-02-19T18:00:00 1951 2 19 18 mi 4 │ 5101 1951-02-20T00:00:00 1951 2 20 0 mi 5 │ 5101 1951-02-20T06:00:00 1951 2 20 6 mi ⋯ 6 │ 5101 1951-02-20T12:00:00 1951 2 20 12 mi 7 │ 5101 1951-02-20T18:00:00 1951 2 20 18 mi 8 │ 5101 1951-02-21T00:00:00 1951 2 21 0 mi ⋮ │ ⋮ ⋮ ⋮ ⋮ ⋮ ⋮ ⋱ 67885 │ 2122 2021-12-19T18:00:00 2021 12 19 18 RA ⋯ 67886 │ 2122 2021-12-20T00:00:00 2021 12 20 0 RA 67887 │ 2122 2021-12-20T06:00:00 2021 12 20 6 RA 67888 │ 2122 2021-12-20T12:00:00 2021 12 20 12 RA 67889 │ 2122 2021-12-20T18:00:00 2021 12 20 18 RA ⋯ 67890 │ 2122 2021-12-21T00:00:00 2021 12 21 0 RA 67891 │ 2122 2021-12-21T06:00:00 2021 12 21 6 RA 13 columns and 67876 rows omitted

Note that JMA returns two datasets, the metadata which contains the information about the storm, and the corresponding data of the storm tracks. For the description of the columns, please refer to JMA documentation.

As for IBTrACS, there is only one data containing all the information about the cyclone.

julia> data = load(BestTrack, :ibtracs);
julia> data240845×163 DataFrame Row │ SID SEASON NUMBER BASIN SUBBASIN NAME ISO_TIM ⋯ │ String15 Int64 Int64 String3 String3 String31 String3 ⋯ ────────┼─────────────────────────────────────────────────────────────────────── 1 │ 1884177N17124 1884 14 WP MM NOT_NAMED 1884-06 ⋯ 2 │ 1884177N17124 1884 14 WP MM NOT_NAMED 1884-06 3 │ 1884177N17124 1884 14 WP MM NOT_NAMED 1884-06 4 │ 1884177N17124 1884 14 WP MM NOT_NAMED 1884-06 5 │ 1884177N17124 1884 14 WP MM NOT_NAMED 1884-06 ⋯ 6 │ 1884177N17124 1884 14 WP MM NOT_NAMED 1884-06 7 │ 1884177N17124 1884 14 WP MM NOT_NAMED 1884-06 8 │ 1884177N17124 1884 14 WP MM NOT_NAMED 1884-06 ⋮ │ ⋮ ⋮ ⋮ ⋮ ⋮ ⋮ ⋱ 240839 │ 2022099N11127 2022 23 WP MM MEGI 2022-04 ⋯ 240840 │ 2022099N11127 2022 23 WP MM MEGI 2022-04 240841 │ 2022099N11127 2022 23 WP MM MEGI 2022-04 240842 │ 2022099N11127 2022 23 WP MM MEGI 2022-04 240843 │ 2022099N11127 2022 23 WP MM MEGI 2022-04 ⋯ 240844 │ 2022099N11127 2022 23 WP MM MEGI 2022-04 240845 │ 2022099N11127 2022 23 WP MM MEGI 2022-04 157 columns and 240830 rows omitted

Please refer to IBTrACS documentation for the description of the columns of the data above.

Deleting

The downloaded data are saved in the local directory of your machine, and the following APIs helps on managing this data, in particular for deleting the said data.

julia> # delete only the Best Track of JMA Data
       delete!(BestTrack, :jma)[ Info: JMA Best Track DB successfully deleted.
julia> # delete all JMA Data folders and files delete!(:jma)[ Info: JMA DB successfully deleted.

For IBTrACS,

julia> # delete only the Best Track of IBTrACS Data
       delete!(BestTrack, :ibtracs)[ Info: IBTrACS Best Track DB successfully deleted.
julia> # delete all IBTrACS Data folders and files delete!(:ibtracs)[ Info: IBTrACS DB successfully deleted.