用于数据管道的无代码/低代码工具与分布式账本技术(DLT)

1作者: nakassony21 天前原帖
大家好, 我一直在开发Client DLT,这是一个开源的用户界面工具,旨在通过无代码或低代码的方式创建和管理DLThub管道。目前,它是一个早期的最小可行产品(MVP)——虽然可以正常工作,但仍存在一些错误和缺失的功能(例如数据库目录、API目录、管道合并、现有DLT脚本的导入等)。 我构建这个工具是因为DLT是一个非常强大的数据管道工具,我们可以为管道创建开发脚本。这个客户端的想法是提供一种简单的方法,不仅用于创建管道,还包括调度、监控、协调、版本管理等。此外,它还为我们的管道管理流程增加了一个AI层。 您可以在这里查看: https://github.com/nbernardo/dlt-client 演示: 1. 创建基本管道: https://lnkd.in/eZw-isTV 2. 为管道调度作业: https://lnkd.in/eNjsuWT3 3. 管道版本管理、数据转换和文件系统源: https://lnkd.in/eazgrTrM 如果有人感兴趣,我非常欢迎反馈、建议,甚至是贡献(想法、代码等)。 谢谢! Nakassony Bernardo
查看原文
Hi everyone, I’ve been working on Client DLT, an open-source UI tool that aims to create&#x2F;manage DLThub pipelines through no&#x2F;low-code.<p>Right now, it’s an early MVP — it works, but still has a few bugs and missing features (like Database catalog, API catalog, pipeline merging, Existing DLT script onboarding, etc). I built it because DLT is quite powerful Data pipeline tools where we develop the scripts for pipeline creation, this client idea is to provide an easy way not only for creating, but also scheduling, monitoring, orchestrating, versioning, and more. Also it adds an AI layer to our pipeline management flow.<p>You can check it out here: https:&#x2F;&#x2F;github.com&#x2F;nbernardo&#x2F;dlt-client demo: 1. Creating a basic pipeline: https:&#x2F;&#x2F;lnkd.in&#x2F;eZw-isTV 2. Scheduling a job for pipeline: https:&#x2F;&#x2F;lnkd.in&#x2F;eNjsuWT3 3. Pipeline versioning, Data transformation and File system sourceing: https:&#x2F;&#x2F;lnkd.in&#x2F;eazgrTrM<p>I’d love feedback, suggestions, or even contributions (ideas, code, etc) if anyone’s interested.<p>Thanks!<p>Nakassony Bernardo