Skip to content

djptek/spainFiestas

Folders and files

NameName
Last commit message
Last commit date

Latest commit

678b0dc · Jul 1, 2020

History

46 Commits
Oct 17, 2019
Jun 11, 2019
Jun 10, 2019
Jul 1, 2020
Oct 10, 2019
Apr 18, 2020
Sep 17, 2019
Jun 10, 2019
Jun 10, 2019
Jun 10, 2019

Repository files navigation

For 2019 & 2020 I translated the fiestas into Json, incuding:

  • Fiesta Nacional no sustituible
  • Fiesta Nacional respecto de la que no se ha ejercido la facultad de sustitución
  • Fiesta de Comunidad Autónoma

Source: https://www.boe.es/diario_boe/verifica.php?c=BOE-A-2018-14369&acc=Verificar&fix_bug_chrome=foo.pdf

Source: https://www.boe.es/diario_boe/txt.php?id=BOE-A-2019-14552

Additional Data: lat/lon from http://centrodedescargas.cnig.es/CentroDescargas/equipamiento.do?method=mostrarEquipamiento See License: http://www.ign.es/resources/licencia/Condiciones_licenciaUso_IGN.pdf

Adapted from native *.mdb format using: https://github.com/brianb/mdbtools thanks @brianb really useful toolkit

Valencia Province Municipality Fiestas edited and partially corrected by hand from: http://www.indi.gva.es/documents/21189/167329017/Calendari+Laboral+Val%C3%A8ncia+-+2019/dcab751f-c6d7-4ea5-9a6b-a51bf69a4d24

Note: Pending Update to http://www.indi.gva.es/documents/21189/169371820/Calendario+laboral+Val%C3%A8ncia+2020./e1bab491-fc38-4144-b35b-3b47d5920a86

Please check vs PDF in case of error & PRs welcome to add any Municipal Fiestas for Other Communities fiestas.

Please name your file:

provincias.<provincia>.fiestas.municipales.ndjson

and use the following format:

{"provincia":"VALÈNCIA","municipio":"ADEMUZ","date":"29-04-2019","fiesta":"SANT VICENT FERRER"}
{"provincia":"VALÈNCIA","municipio":"ADEMUZ","date":"12-08-2019","fiesta":"L’ASSUMPCIÓ DE LA MARE DE DÉU"}
{"provincia":"VALÈNCIA","municipio":"ADOR","date":"21-08-2019","fiesta":"MARE DE DÉU DE LORETO"}
{"provincia":"VALÈNCIA","municipio":"ADOR","date":"22-08-2019","fiesta":"SANTISSEM CRIST DE L’EMPAR"}

Note: Please use a separate line for each fiesta/municipio

usage: spain.fiestas
 -h,--help             Show this help
 -H,--host <arg>       Host default <localhost>
 -p,--password <arg>   password default <password>
 -P,--port <arg>       Port default <9200>
 -S,--scheme <arg>     Scheme [http|https] default <http>
 -u,--username <arg>   username default <elastic>

To-do:

  • Tidy up command line params
  • Move Community coordinates into separate resource file
  • add Municipalities WIP

Then I indexed it into Elasticsearch see: https://github.com/elastic/elasticsearch

This application will create a pipeline + 2 x indices with pre-defined mappings in your local Elasticsearch cluster

fiestas_vs_comunidad_autonoma is a bulk import of https://github.com/djptek/spainFiestas/blob/master/src/main/resources/fiestas.js

comunidad_autonoma_vs_fiestas refactors the data by denormalizing, joined by comunidad and adding [lon, lat] and isocode so that you can map the data using Kibana see: https://github.com/elastic/kibana

Here are some sample queries Vs fiestas_vs_comunidad_autonoma

# How many days in the year have a fiesta (somewhere)?
# (some days have more than one fiesta)
GET fiestas_vs_comunidad_autonoma/_search
{
 "size": 0,
 "aggs": {
   "count_dates": {
     "cardinality": {
       "field": "date"
       }
     }
   }
 }
}

# Fiesta Count by Community
GET fiestas_vs_comunidad_autonoma/_search
{
 "size": 0,
 "aggs": {
   "check_comunidades": {
     "terms": {
       "field": "comunidadesLoader",
       "size": 19,
       "order": {
         "_key": "asc"
       }
     }
   }
 }
}

# All Fiestas foreach Community
GET fiestas_vs_comunidad_autonoma/_search?filter_path=**.key
{
 "size": 0,
 "aggs": {
   "my_comunidades": {
     "terms": {
       "field": "comunidadesLoader",
       "size": 19,
       "order": {
         "_key": "asc"
       }
     },
     "aggs": {
       "my_local_fiesta": {
         "terms": {
           "script": {
             "source": "doc['date'].value.toLocalDate()+' - '+doc['fiesta.keyword'].value"
           },
           "size": 100
         }
       }
     }
   }
 }
}

# When is San José?
GET fiestas_vs_comunidad_autonoma/_search?filter_path=**.date
{
 "query": {
   "match_phrase": {
     "fiesta": "San José"
   }
 }
}

# Which Community celebrates San José?
GET fiestas_vs_comunidad_autonoma/_search?filter_path=**.comunidadesLoader
{
 "query": {
   "match_phrase": {
     "fiesta": "San José"
   }
 }
}

# How many days are Fiestas when Madrid doesn't have a fiesta?
GET fiestas_vs_comunidad_autonoma/_search
{
 "size": 0, 
 "query": {
   "bool": {
     "must_not": [
       {"match": {
         "comunidadesLoader": "MADRID"
       }}
     ]
   }
 },
 "aggs": {
   "remove_duplicate_dates": {
     "cardinality": {
       "field": "date"
     }
   }
 }
}

Here is a sample aggregation Vs comunidad_autonoma_vs_fiestas

# Now let's aggregate on the geo_point field
GET comunidad_autonoma_vs_fiestas/_search
{
 "aggs": {
   "filter_agg": {
     "filter": {
       "geo_bounding_box": {
         "ignore_unmapped": true,
         "location_geo_point": {
           "top_left": {
             "lat": 52.11025,
             "lon": -24.86206
           },
           "bottom_right": {
             "lat": 26.49397,
             "lon": 16.66626
           }
         }
       }
     },
     "aggs": {
       "2": {
         "geohash_grid": {
           "field": "location_geo_point",
           "precision": 4
         },
         "aggs": {
           "3": {
             "geo_centroid": {
               "field": "location_geo_point"
             }
           }
         }
       }
     }
   }
 },
 "size": 0
}

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages