Tag: Open Data

Posted on

Final Thesis: Design und Implementierung eines Konzepts zur Live-Konfiguration

Abstract: Nowadays a variety of systems generate and handle more and more data. This data is often presented in different formats and has to be retrieved from various locations. The Open Data Service (ODS) presents a system to conquer those tasks. The ODS allows the definition of data manipulation pipelines to process and convert data. Those data transformations are defined by code snippets executed on the data.

This thesis presents a concept for the live configuration of those transformations. With live configuration the user receives instant feedback about his code, similar to using an integrated development environment (IDE). A live preview of the resulting data is also shown. The result is a faster and more efficient development of the transformation snippets. The thesis describes the creation of the live configuration concept and documents an exemplary implementation of the concept as a web application.

Keywords: JValue Open Data Service, live configuration

PDF: Master Thesis

Reference: Karl Lugwig Werner. Design und Implementierung eines Konzepts zur Live-Konfiguration. Master Thesis, Friedrich-Alexander-Universität Erlangen-Nürnberg: 2019.

Posted on

Final Thesis: Development of a Microservice for Open Weather Data

Abstract: Since mid 2017 the Deutscher Wetterdienst (DWD) has been obligated to provide its weather data to the public for free. However, anyone who wants to access it needs to click through a file system hoping to still be on the right path to the desired weather data. Due to confusing folder names this turns into a frustrating experience very quickly. The data then comes in various formats, making it hard to automatically process it.

In order to stop this hassle, we present a microservice that adapts weather data from the DWD server to a more user friendly REST interface. This thesis describes the architecture and implementation of the microservice. As a result, users can fetch historical, current and forecast weather data of twenty different weather parameters in an easy to process JSON format.

Keywords: Open source, open data, open data service, JValue ODS, DWD, weather

PDF: Master Thesis

Reference: Daniel Vahle. Development of a Microservice for Open Weather Data . Master Thesis, Friedrich-Alexander-Universität Erlangen-Nürnberg: 2019.

Posted on

Final Thesis: Migration the JValue ODS to Microservices

Abstract: “A world in which consuming open data is easy and safe.“ This is the vision of the JValue Open Data Service (ODS) that aims to bundle finding the right open data, using and combining it into an easy and intuitive process. The daily life of developers should be free from hardships, like writing data crawlers for different data formats in combination with different protocols, and instead, let them focus on their real problems.

As in every crowd-sourced application, the more users contributing and adding new data sources, the better. With these requirements, the need for a scalable software emerges. The microservice-based approach promises to achieve this, as well as making the project easier to understand and maintain for developers.

This thesis presents a microservice-based architecture draft for the ODS and a migration strategy from the current monolithic architecture towards it. The exemplary implementation of a selected microservice proofs the feasibility of such an architectural style. Furthermore, a discussion about the challenges and benefits of a distributed system and the experiences written down in this thesis shall reduce the risks and enable a complete migration to a microservices-based architecture in the future.

Keywords: Open source, open data, open data service, JValue ODS

PDF: Master Thesis

Reference: Georg Schwarz. Migration the JValue ODS to Microservices. Master Thesis, Friedrich-Alexander-Universität Erlangen-Nürnberg: 2019.

Posted on

Final Thesis: Implementation of a Web-UI for a Guided Configuration Workflow

Abstract: Open Data has a huge potential, but due to its often poor quality and inconsistency most of this data can’t be used, at least not without a lot of effort. Here the Open Data Service is bringing remedy, because this tool can homogenize such data structures. Still, because the data has such great variety, the complexity of the structure is shifted onto the configuration possibilities, which makes the ODS unwieldy to use. Therefore this thesis presents the requirements of a configuration application and provides an implementation in form of an Angular based web application, that is used to make the  ODS more approachable by giving it the functionality of creating configurations in a better and more comfortable way.

Keywords: Open source, open data, open data service, JValue ODS

PDF: Bachelor Thesis

Reference: Artur Wasinger. Implementation of a WEB-UI for a Guided Configuration Workflow. Bachelor Thesis, Friedrich-Alexander-Universität Erlangen-Nürnberg: 2018.

Posted on

Final Thesis: Design and Implementation of a RESTful API for Heterogeneous Data (in German)

Abstract: Public institutions produce large amounts of publicly available data. Still, due to its poor quality and inconsistent structure, the potential of this data remains unused for the most part. The JValue Open Data Service was established to enhance the quality of this data and give it a standardized structure. It is supposed to make the potential of open data more accessible to the public by exposing it via a simple, comprehensible and scalable API. The current most popular approach for the design of such high quality APIs is the architectural style called “REST”. The existing API of the open data service has been designed as a RESTful API but does not meet the standards of the architectural style. The present thesis aims at creating a new API that fulfills all requirements that are needed to be genuinely RESTful. For this purpose, I carried out a closer analysis of the REST paradiga, as presented by its inventor Roy Fielding. With this conceptual background, a truly RESTful API was designed and implemented to help realizing the full potential of open data.

Keywords: Open source, open data, open data service, JValue ODS

PDF: Bachelor Thesis

Reference: Mathias Zinnen. Design und Implementierung einer RESTful API für Heterogene Daten. Bachelor Thesis, Friedrich-Alexander-Universität Erlangen-Nürnberg: 2018.