Supplying Vector, Data Limitation on Get Trade Data #7

satria-aji · 2023-11-28T03:38:48Z

satria-aji
Nov 28, 2023

I was about maintaining a database of exports for all HS using bps_get_trade_hs_chapter. From the documentation, Inf can be used to get data from 2014 - latest. Any thoughts on extracting all chapters for the HS Code? I tried multiple attempts but resulting in error "this request yields no data." Also, is there any limitation on data that can be extracted?

Answered by dzulfiqarfr

Dec 4, 2023

It seems that the API has a limit on the amount of data we can get on a single request. The workaround, at least for now, is bps_request_multiple() (read more in the function's documentation). With this function, we can get the data in all chapters across all available years, as follows. (You may want to read the API documentation to use the original name-value pairs of the query parameters.)

library(bpsr)

hsCode <- bps_hs_code()

hsChapter <- unique(hsCode$hs_chapter)

bps_request_multiple(
  "dataexim",
  list(
    jenishs = "1", # Chapter
    kodehs = hsChapter,
    sumber = "1", # Export
    periode = "2", # Monthly
    tahun = paste0(seq(2014, 2023), collapse = ";")
  )
)
#> <bpsr_m…

View full answer

dzulfiqarfr · 2023-11-29T09:21:12Z

dzulfiqarfr
Nov 29, 2023
Maintainer

Hello. Could you please provide a reproducible example of the code you tried to run?

0 replies

satria-aji · 2023-12-04T07:16:27Z

satria-aji
Dec 4, 2023
Author

tried vector alternative with this. I had it once that it worked, unfortunately now it ended in 'this request yield no data' error message

`helphscode <- bps_hs_code()
unique_hs_chapters <- unique(helphscode$hs_chapter)
ekspor_23 <- bps_get_trade_hs_chapter(hs_chapter = unique_hs_chapters, "export", year = 2022)`

Update: for now, the only way is to extract each HS manually, one line for one flow per HS code. Any help will be appreciated!

2 replies

dzulfiqarfr Dec 4, 2023
Maintainer

It seems that the API has a limit on the amount of data we can get on a single request. The workaround, at least for now, is bps_request_multiple() (read more in the function's documentation). With this function, we can get the data in all chapters across all available years, as follows. (You may want to read the API documentation to use the original name-value pairs of the query parameters.)

library(bpsr)

hsCode <- bps_hs_code()

hsChapter <- unique(hsCode$hs_chapter)

bps_request_multiple(
  "dataexim",
  list(
    jenishs = "1", # Chapter
    kodehs = hsChapter,
    sumber = "1", # Export
    periode = "2", # Monthly
    tahun = paste0(seq(2014, 2023), collapse = ";")
  )
)
#> <bpsr_multiple_responses>
#> Status:
#> • OK: 98
#> • Error: 0
#> Data availability:
#> • Available: 98
#> • Not available: 0
#> Contents:
#> List of 98
#>  $ :List of 4
#>   ..$ status           : chr "OK"
#>   ..$ data-availability: chr "available"
#>   ..$ metadata         :List of 7
#>   .. ..$ source   : chr "Sumber : https://www.bps.go.id diakses pada 05-12-2023 01:17:23 WIB"
#>   .. ..$ value    : chr "Nilai Ekspor/Impor dalam US Dollar ($)"
#>   .. ..$ netweight: chr "Berat Ekspor/Impor dalam Kilogram (KG)"
#>   .. ..$ kodehs   : chr "Kode dan Deskripsi dari HS"
#>   .. ..$ pod      : chr "Pelabuhan Masuk/Keluar di Indonesia"
#>   .. .. [list output truncated]
#>   ..$ data             :'data.frame':    780 obs. of  6 variables:
#>   .. ..$ value    : num [1:780] 325978 ...
#>   .. ..$ netweight: num [1:780] 1e+05 ...
#>   .. ..$ kodehs   : chr [1:780] "[01] Binatang hidup" ...
#>   .. ..$ pod      : chr [1:780] "SOEKARNO-HATTA (U)" ...
#>   .. ..$ ctr      : chr [1:780] "SINGAPORE" ...
#>   .. .. [list output truncated]
#>  $ :List of 4
#>   ..$ status           : chr "OK"
#>   ..$ data-availability: chr "available"
#>   ..$ metadata         :List of 7
#>   .. ..$ source   : chr "Sumber : https://www.bps.go.id diakses pada 05-12-2023 01:17:22 WIB"
#>   .. ..$ value    : chr "Nilai Ekspor/Impor dalam US Dollar ($)"
#>   .. ..$ netweight: chr "Berat Ekspor/Impor dalam Kilogram (KG)"
#>   .. ..$ kodehs   : chr "Kode dan Deskripsi dari HS"
#>   .. ..$ pod      : chr "Pelabuhan Masuk/Keluar di Indonesia"
#>   .. .. [list output truncated]
#>   ..$ data             :'data.frame':    341 obs. of  6 variables:
#>   .. ..$ value    : num [1:341] 976 ...
#>   .. ..$ netweight: num [1:341] 440 ...
#>   .. ..$ kodehs   : chr [1:341] "[02] Daging dan sisa daging yang dapat dimakan" ...
#>   .. ..$ pod      : chr [1:341] "BATU AMPAR" ...
#>   .. ..$ ctr      : chr [1:341] "MALAYSIA" ...
#>   .. .. [list output truncated]
#>  $ :List of 4
#>   ..$ status           : chr "OK"
#>   ..$ data-availability: chr "available"
#>   ..$ metadata         :List of 7
#>   .. ..$ source   : chr "Sumber : https://www.bps.go.id diakses pada 05-12-2023 01:17:23 WIB"
#>   .. ..$ value    : chr "Nilai Ekspor/Impor dalam US Dollar ($)"
#>   .. ..$ netweight: chr "Berat Ekspor/Impor dalam Kilogram (KG)"
#>   .. ..$ kodehs   : chr "Kode dan Deskripsi dari HS"
#>   .. ..$ pod      : chr "Pelabuhan Masuk/Keluar di Indonesia"
#>   .. .. [list output truncated]
#>   ..$ data             :'data.frame':    5609 obs. of  6 variables:
#>   .. ..$ value    : num [1:5609] 280237 ...
#>   .. ..$ netweight: num [1:5609] 126855 ...
#>   .. ..$ kodehs   : chr [1:5609] "[03] Ikan dan krustasea, moluska serta invertebrata air lainnya" ...
#>   .. ..$ pod      : chr [1:5609] "MAKASSAR" ...
#>   .. ..$ ctr      : chr [1:5609] "CHINA" ...
#>   .. .. [list output truncated]
#>  $ :List of 4
#>   ..$ status           : chr "OK"
#>   ..$ data-availability: chr "available"
#>   ..$ metadata         :List of 7
#>   .. ..$ source   : chr "Sumber : https://www.bps.go.id diakses pada 05-12-2023 01:17:23 WIB"
#>   .. ..$ value    : chr "Nilai Ekspor/Impor dalam US Dollar ($)"
#>   .. ..$ netweight: chr "Berat Ekspor/Impor dalam Kilogram (KG)"
#>   .. ..$ kodehs   : chr "Kode dan Deskripsi dari HS"
#>   .. ..$ pod      : chr "Pelabuhan Masuk/Keluar di Indonesia"
#>   .. .. [list output truncated]
#>   ..$ data             :'data.frame':    1430 obs. of  6 variables:
#>   .. ..$ value    : num [1:1430] 1303 ...
#>   .. ..$ netweight: num [1:1430] 40.4 ...
#>   .. ..$ kodehs   : chr [1:1430] "[04] Milk, butter, and egg" ...
#>   .. ..$ pod      : chr [1:1430] "SOEKARNO-HATTA (U)" ...
#>   .. ..$ ctr      : chr [1:1430] "THAILAND" ...
#>   .. .. [list output truncated]
#>  $ :List of 4
#>   ..$ status           : chr "OK"
#>   ..$ data-availability: chr "available"
#>   ..$ metadata         :List of 7
#>   .. ..$ source   : chr "Sumber : https://www.bps.go.id diakses pada 05-12-2023 01:17:23 WIB"
#>   .. ..$ value    : chr "Nilai Ekspor/Impor dalam US Dollar ($)"
#>   .. ..$ netweight: chr "Berat Ekspor/Impor dalam Kilogram (KG)"
#>   .. ..$ kodehs   : chr "Kode dan Deskripsi dari HS"
#>   .. ..$ pod      : chr "Pelabuhan Masuk/Keluar di Indonesia"
#>   .. .. [list output truncated]
#>   ..$ data             :'data.frame':    1494 obs. of  6 variables:
#>   .. ..$ value    : num [1:1494] 32244 ...
#>   .. ..$ netweight: num [1:1494] 2158 ...
#>   .. ..$ kodehs   : chr [1:1494] "[05] Produk hewani, tidak dirinci atau termasuk dalam pos lain" ...
#>   .. ..$ pod      : chr [1:1494] "TANJUNG PERAK" ...
#>   .. ..$ ctr      : chr [1:1494] "ITALY" ...
#>   .. .. [list output truncated]
#>   [list output truncated]

^{Created on 2023-12-05 with reprex v2.0.2}

The above code returned 98 responses, in line with the number of the HS chapters. Under the hood, the function performed multiple requests at once—which should be faster than iterating bps_get_trade_hs_chapter(). Each request for a single chapter across all available years.

Hope this works for you 🙏🏽

Answer selected by dzulfiqarfr

satria-aji Dec 12, 2023
Author

Thanks a lot for the help! it gets much simpler for now

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Supplying Vector, Data Limitation on Get Trade Data #7

{{title}}

Replies: 2 comments 2 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

Select a reply

Supplying Vector, Data Limitation on Get Trade Data #7

satria-aji Nov 28, 2023

Replies: 2 comments · 2 replies

dzulfiqarfr Nov 29, 2023 Maintainer

satria-aji Dec 4, 2023 Author

dzulfiqarfr Dec 4, 2023 Maintainer

satria-aji Dec 12, 2023 Author

satria-aji
Nov 28, 2023

Replies: 2 comments 2 replies

dzulfiqarfr
Nov 29, 2023
Maintainer

satria-aji
Dec 4, 2023
Author

dzulfiqarfr Dec 4, 2023
Maintainer

satria-aji Dec 12, 2023
Author