Avaliando a avaliação: uma análise do processo de acompanhamento, monitoramento e avaliação dos contratos de gestão da SESAB

Abstract

This research aimed to evaluate how the Health Department of the State of Bahia (Sesab) carries out the Process of Monitoring, Following-up, and Evaluating the management contracts (PMA) under its responsibility. We sought to describe the PMA (as established by the State Program of Social Organizations), and how the Sesab carries it out, identifying the main obstacles and advances in the process. To elaborate the methodological design, it was necessary to adopt evaluation criteria for meta-evaluation, which were adapted from the model developed by the Federal Court of Accounts (TCU) for the elaboration of the Maturity Index of the Evaluation Systems of Government Programs. The scope of those interviewed was formed by technical evaluators and managers of the coordinations responsible for the PMA; adding to the analysis of the payment processes of the social organizations and the audit reports of the internal and external control bodies. The main results obtained were the absence of standardization and institutionalization of methodologies and processes; absence of a Business Intelligence System; undersized teams with no effective staff in their composition; servers without formal training; deficient communication; timeliness of information. Even so, future research is needed, such as: comparative analysis of monitoring and evaluation systems for the provision of services that may be adopted by the Public Administration; analysis of the cost of contracting partnerships with social organizations versus the cost of direct management of the unit carried out by Sesab; analysis of the quality of services provided by social organizations versus the quality of services provided by direct management carried out by Sesab. The results demonstrate that the Sesab faces a great challenge ahead, to the extent that it may be necessary to restructure or redesign its process for monitoring and evaluating management contracts. Consequently, it has an impact on reassessing the State Program of Social Organizations, in spite of its actions of control, inspection, monitoring, and evaluation of the partner units