The Transferencias Constitucionais API changed on the server side:
parameter names became case-sensitive (lower case) and the municipal
endpoints became paginated (page/pageSize, 10
rows per page by default). With the old upper-case names the server
ignored every filter and timed out (HTTP 504), which looked like an
outage.
get_tc_por_municipio() /
get_tc_by_municipality() and the _detalhe /
_detail variants now send p_estado,
p_municipio (singular), p_ano,
p_mes, p_transferencia and
p_sn_detalhar, and fetch every page (new arguments
page_size = 1000 and max_rows = Inf). A page
failing after the first returns the rows fetched so far with
attr(x, "partial") = TRUE.get_tc_por_municipio_detalhe() /
get_tc_by_municipality_detail() keep the original contract,
which that endpoint still uses: upper-case names,
P_MUNICIPIOS, no pagination. It now also documents the
ten-day installment columns it returns.The SICONFI report getters were renamed so their scope is explicit:
_ufs suffix:
get_rreo() → get_rreo_ufs(),
get_dca() → get_dca_ufs(),
get_rgf() → get_rgf_ufs() (and the English
aliases get_budget_report_ufs(),
get_annual_accounts_ufs(),
get_fiscal_report_ufs())._for_state to _municipios (PT) /
_municipalities (EN): get_rreo_for_state() →
get_rreo_municipios() /
get_budget_report_municipalities(), and likewise for DCA
and RGF.The old names still work but are deprecated and emit
a .Deprecated() warning; they forward to the new names and
will be kept for at least one release cycle. See
?"tesouror-deprecated".
get_siope_*() functions gained a tipo
argument (type in the English aliases) that filters by
entity type on the server via the DS_TIPO
column. Pass tipo = "estado" (or "uf") to
fetch only the state-level row, or tipo = "municipio" for
the municipalities, instead of downloading the whole UF + municipalities
payload. Accepts PT/EN synonyms (accent- and case-insensitive) and
combines with an existing filter via and.co_esfera is now optional in
get_rreo() (and the sphere argument
of get_budget_report()), defaulting to NULL.
When NULL the sphere filter is omitted from the request.
Some SICONFI entities — notably the Federal District constitutional fund
(id_ente = 1) — only return data when
co_esfera is absent; previously the argument was
mandatory, making those records unreachable. Existing calls that pass
co_esfera are unaffected.CRAN auto-check fixes for the 0.2.1 submission:
R/rreo_tidy.R (in
tidy_rreo()’s @details) with
"up to". The original character broke the LaTeX manual
build on r-devel-windows and r-devel-linux-debian-gcc.https://www.condepefidem.pe.gov.br link
from vignettes/transferencias_pernambuco.Rmd (the agency’s
site times out from CRAN’s checkers). The CONDEPE/FIDEM attribution
stays as plain text.ords_fetch_all() now returns partial results
on mid-pagination failures. When a page after the first fails
(e.g., HTTP 504 after the retry budget is exhausted), the package no
longer discards the rows it had already fetched. Instead it logs a
warning and returns the partial tibble with
attr(result, "partial") = TRUE and
attr(result, "last_page_error") describing the failure.
This matters most for CUSTOS, where the backend timeout caused users to
lose hundreds of rows from a successful first page when page two
stalled.
CUSTOS default page_size lowered to
500 (was 1000). The CUSTOS load balancer became more aggressive
about cutting slow queries; 1000 rows often times out on broad queries
even with month and org filters. 500 is a more robust starting point at
the cost of a few extra round-trips.
More actionable HTTP 504 error message for
CUSTOS — explicitly suggests adding a mes filter
and/or reducing page_size, and reminds the user that
partial results are now available via attributes.
README’s CUSTOS quick-start example now passes a
month filter so copy-paste users do not hit the 504
ceiling.
Fault-tolerant batch fetchers for SICONFI. New
helpers get_rreo_for_state(),
get_dca_for_state(), and get_rgf_for_state()
(plus English aliases get_budget_report_for_state(),
get_annual_accounts_for_state(),
get_fiscal_report_for_state()) fetch data for every
municipality of a Brazilian state in a single call. They loop over the
underlying SICONFI endpoint per municipality and tolerate per-entity
failures: when an individual call cannot be recovered after the
five-attempt retry budget, the failure is recorded and the loop
continues. Failed calls are returned via
attr(result, "failed") (a tibble with
iteration, id, error). The
on_error argument controls behaviour: "warn"
(default), "stop", or "silent". This addresses
the fault-tolerance and missing-municipality concerns reported in rsiconfi#2
and rsiconfi#3.
Distinct reporting for empty responses. The
SICONFI API replies HTTP 200 with zero rows when an entity has not
homologated a given report (a common cause of “missing municipalities”
complaints). The new batch fetchers expose these cases via
attr(result, "no_data") (a tibble with
iteration, id), separate from technical
failures in attr(result, "failed").
Layout-aware RREO tidy layer. New functions
rreo_layout(), rreo_normalize_columns(), and
tidy_rreo() reconcile SICONFI’s drifting column and account
labels across fiscal years. The bundled
inst/extdata/rreo_layout.csv knows that, for example, the
federal RGPS appendix moved from RREO-Anexo 04.3 - RGPS
(≤2022) to RREO-Anexo 04.4 - RGPS (2023+) and that account
names with shifting Roman numerals
("... (VII) = (III - VI)") are matched on a stable stem.
rreo_normalize_columns() adds a coluna_padrao
(year-stripped) and a coluna_ano (the year that appeared in
the suffix, or NA), letting users distinguish a
current-year column from a comparative previous-year column.
tidy_rreo(data, topic = "previdencia") returns a
year-stable indicator column ready for longitudinal analysis, collapsing
the manual
paste0(... ifelse(year >= 2021, "", " / "), ...)
workarounds that were the workhorse for issue rsiconfi#4.
Currently ships rules for federal previdência (RGPS, RPPS civis, FCDF,
militares); contributions for additional topics are welcome. See the new
vignette vignette("rreo-longitudinal") for an end-to-end
walkthrough.
New dependency:
stringi (>= 1.7.0) (for portable diacritic stripping;
already a transitive dependency via stringr).
Added a hard Depends: R (>= 4.1.0) to reflect the
use of the native pipe (|>) inside the package.
UF abbreviation guard for Transferencias.
get_tc_municipios(), get_tc_por_estados(),
get_tc_por_estados_detalhe(),
get_tc_por_municipio(), and
get_tc_por_municipio_detalhe() now abort with an actionable
error if a two-letter Brazilian UF abbreviation (e.g.,
"PE") is passed where a numeric Treasury state code is
expected. Previously the upstream API returned HTTP 500 after a long
retry budget; the new check fires before any network call and points the
user to get_tc_estados().
tesouror expands the former siconfir
package into a unified interface for all Brazilian National Treasury
open data APIs.
siconfir
package).organizacao_n1/n2/n3 parameters in the CUSTOS API.tesouror_clear_cache()).page_size parameter to control rows per page (CUSTOS
defaults to 1000 instead of the server’s slow default of 250; SIOPE
defaults to 1000).max_rows parameter on all paginated functions to cap
the number of rows returned. Automatically adjusts
limit/$top to avoid fetching unnecessary
data.verbose parameter on every function to print the full
API URL for debugging or testing in a browser/curl. Can be set globally
with options(tesouror.verbose = TRUE).janitor::clean_names() applied to all responses for
consistent snake_case column names.244 →
"000244").$filter, $orderby, and
$select support for server-side filtering, sorting, and
column selection.c(1, 2, 3)) in addition to colon-separated strings
("1:2:3").