Contributor
Adwait Godbole

bowtie-trend - Long-Term Reporting With Bowtie


Mentors
Julian Berman, Agnivesh Chaubey
Organization
JSON Schema
Technologies
python, typescript, react.js, GitHub workflows, Chart.js, Data Processing Skills
Topics
json, JSON Schema, Trend Reports
The JSON Schema test suite is a collection of JSON schemas, instances (data) and expected validation results -- meaning information about what result an implementation of JSON Schema is expected to produce. These "known correct results" are used by a huge number of implementations of JSON Schema in order to ensure they behave correctly under the JSON Schema specification. My proposal involves enhancing the functionality of Bowtie, a tool designed for comparing results from running the JSON Schema test suite across various implementations. Currently, Bowtie generates reports indicating test pass or fail rates for each implementation. The objective is to develop a feature that tracks how these results evolve over time due to bug fixes, new test additions, etc. This involves creating a new 'bowtie trend' command to aggregate and analyze results, enabling users to visualize trends in compliance numbers over time. By integrating this feature into the Bowtie website, users will be able to access graphical representations of failed tests over different time periods. Deliverables and plan: Development of a new 'bowtie trend' command for aggregating and analyzing compliance results over time. Integration of trend analysis into the Bowtie website to generate graphs illustrating changes in test outcomes.