Apache Hop

[🧑🏫Formation] Passez de la théorie à la pratique avec Apache Hop ! L’intégration de données est au cœur des projets numériques… mais encore faut-il savoir la mettre en œuvre efficacement. 👉 Avec notre formation Apache HOP (2 jours), l’objectif est simple : vous rendre autonomes rapidement, avec une approche 100 % pratique, basée sur des cas réels. Au programme : • comprendre l’architecture de HOP • construire des pipelines et workflows • appliquer les bonnes pratiques de développement • industrialiser vos traitements de données. 💡 Une formation pensée pour le terrain, par nos équipes qui connaissent vos besoins et déploient des solutions depuis plus de 20 ans. 📊 Quelques repères : - 20 ans d’expérience sur Pentaho / HOP - +600 personnes formées - Une implication active dans la communauté open source 👉 Découvrez le programme : https://lnkd.in/epfY2cTU Jean-Philippe PORCHEROT | Christophe Gavignet | Sylvain Decloix #ApacheHOP #Data #ETL #Formation #OpenSource #DataEngineering #AtolCD

Most teams running Apache Hop in production handle schema migrations the same way: manually, inconsistently, and outside the project. Flyway fixes the consistency problem. But it still lives outside your project, separate execution, separate monitoring, separate failure handling. You can wire it into Apache Hop with a script. Call the Flyway CLI, capture output, react to errors. It works but it's not elegant. Putki has a native Flyway action for Apache Hop workflows. Drop it after a connection check, point it at your #SQL folder, and it runs all pending migrations in order, failing the workflow if anything goes wrong, so your existing monitoring handles it like any other pipeline failure. 👉 https://lnkd.in/ev4BpsVY 👉 https://lnkd.in/et7cGhhb #apachehop #putki #flyway #dataintegration

Good week in the Apache Hop community. Apr 30 – May 7. 26 PRs merged. 23 issues closed. 6 contributors. #AWS key IDs and secrets are now obfuscated in the SNS transform. Credentials staying private by default, exactly how it should be. Hop Server configuration variables are now properly exposed, giving you much better control over your server setup. And HOP_CONFIG_OPTIONS type handling is fixed, making load-and-execute scripts reliable again. The UI keeps getting more polished. Dark mode in the run option dialog now looks great. The taskbar icon shows up correctly on launch. CTRL+V now behaves in SQL input boxes. Data reliability wins too: the TextFileOutput default values regression is resolved, Salesforce Upsert correctly handles external IDs, and the Standardize Phone Number transform returns the right data type. #Google Sheets Output now supports retry and retry delay options, a practical addition for anyone dealing with API rate limits. And a MongoDB QL plugin just landed as a PR. One to watch. And 𝗔𝗽𝗮𝗰𝗵𝗲 𝗛𝗼𝗽 𝟮.𝟭𝟴 is coming... Thanks to everyone who contributed. 🙏 Hans Van Akelyen Nicolas ADMENT Bart Maertens 𝗹𝗮𝗻𝗰𝗲 https://github.com/leehaut 𝗝𝗲𝗳𝗲𝗿𝘀𝗼𝗻 𝗡𝗮𝘃𝗮𝗿𝗿𝗼 Frank Skorgen → https://hop.apache.org → https://lnkd.in/eWpvx9Wh #apachehop #weeklyupdate #community

Your HubSpot data shouldn't be locked inside HubSpot. Contacts. Companies. Products. Deals. Tickets. All of it sitting in your #CRM, and none of it easy to get out cleanly. We built the Putki HubSpot Input plugin to change that. Connect to HubSpot, select the objects you need, and pipe the data wherever it belongs: → Into Odoo for CRM/ERP sync → Into your data warehouse for analytics → Into a staging area for migration → Into any system your pipelines talk to You can do it with standard Apache Hop: loop through paginated REST responses, parse the JSON, handle rate limits, manage the cursor. It works. It's just a lot of plumbing. Or you use the Putki HubSpot Input plugin and it becomes just another input transform, same as reading from a database or a CSV. 👉 https://lnkd.in/g2sYJbPc #apachehop #putki #hubspot #dataintegration

𝗗𝗼𝗰𝘂𝗺𝗲𝗻𝘁𝗮𝘁𝗶𝗼𝗻 𝘁𝗵𝗮𝘁 𝘄𝗿𝗶𝘁𝗲𝘀 𝗶𝘁𝘀𝗲𝗹𝗳. 𝗔𝘂𝘁𝗼𝗱𝗼𝗰 is a 𝗣𝘂𝘁𝗸𝗶 plugin that automatically generates technical documentation from your Apache Hop pipelines and workflows. It reads the project directly and produces structured docs your whole team can use. We just made it significantly more useful. 𝗔𝘂𝘁𝗼𝗱𝗼𝗰 now generates a full HTML documentation site with one page per pipeline and workflow, including details: filter conditions, JavaScript code, transform-level configuration, etc. Everything that used to live only in the heads of the people who built it. Documented automatically. If you want to see 𝗔𝘂𝘁𝗼𝗱𝗼𝗰 in action, we're happy to show you. #apachehop #putki #autodoc #documentation

Apache Hop 𝗔𝗽𝗿 𝟭𝟲-𝟮𝟯. 𝟭𝟬 𝗣𝗥𝘀 𝗺𝗲𝗿𝗴𝗲𝗱. 𝟭𝟵 𝗶𝘀𝘀𝘂𝗲𝘀 𝗰𝗹𝗼𝘀𝗲𝗱. 𝟱 𝗰𝗼𝗻𝘁𝗿𝗶𝗯𝘂𝘁𝗼𝗿𝘀. 🔹 You can now set the #Java version directly from the transform. 🔹 HOP_DISABLE_CONSOLE_LOGGING can now be set via environment variable. 🔹 Manually stopping a transaction-based workflow was silently triggering a commit. Not what you'd expect, not what you'd want. Fixed. 🔹 And "Execute Process" was cutting off replies at 4,120 characters. Also closed. 🔹 The Switch/Case detach bug is gone too. If a transform wasn't properly releasing its target on detach, downstream behavior got unpredictable. Now it doesn't. 🔹 Combination Lookup got an importer fix for PDI/Kettle migrations, a small but meaningful step for teams still making the move to Apache Hop. Steady progress. Week after week. Thanks to everyone who contributed. Hans Van Akelyen Matt Casters 𝗹𝗮𝗻𝗰𝗲 https://github.com/leehaut 𝗝𝗲𝗳𝗲𝗿𝘀𝗼𝗻 𝗡𝗮𝘃𝗮𝗿𝗿𝗼 Bart Maertens → https://hop.apache.org → https://lnkd.in/eWpvx9Wh

We're back. Smaller week, sharper focus. 𝗔𝗽𝗿 𝟵-𝟭𝟲. 𝟭𝟲 𝗣𝗥𝘀. 𝟮𝟬 𝗶𝘀𝘀𝘂𝗲𝘀 𝗰𝗹𝗼𝘀𝗲𝗱. 🔹 Pipeline Executor now runs the right pipeline every time, even when multiple copies are enabled. Reliable by design. 🔹 PostgreSQL Bulk Loader handles boolean values correctly, a long-standing gap that's finally closed. 🔹 Value Mapper is back to its best. Consistent, predictable behavior across new and existing fields, backed by proper tests. Two focused PRs that make a real difference in day-to-day pipeline work. 🔹 Stream Lookup now correctly persists its data source link. 🔹 Database Explorer got a meaningful upgrade to navigation and preview. 🔹 A potential ReDoS vulnerability was caught and hardened before it ever became a problem. 𝗧𝗵𝗿𝗲𝗲 𝗳𝗲𝗮𝘁𝘂𝗿𝗲 𝗿𝗲𝗾𝘂𝗲𝘀𝘁𝘀 𝘄𝗼𝗿𝘁𝗵 𝗸𝗲𝗲𝗽𝗶𝗻𝗴 𝗮𝗻 𝗲𝘆𝗲 𝗼𝗻: reusable metadata for shared pipeline functions, aggregated metrics for multi-copy transforms, and enriched error capture. Thanks to every contributor who showed up this week. Hans Van Akelyen 𝗹𝗮𝗻𝗰𝗲 https://github.com/leehaut 𝗝𝗲𝗳𝗲𝗿𝘀𝗼𝗻 𝗡𝗮𝘃𝗮𝗿𝗿𝗼 → https://hop.apache.org → https://lnkd.in/eWpvx9Wh #apachehop

Odoo is a great ERP. Getting data in and out of it reliably is a different story. Putki's Odoo connector handles reads and writes as part of a proper Apache Hop pipeline. Connect it to your CRM, ecommerce platform, data warehouse, or reporting layer, without custom API code and without the maintenance headache. If that sounds familiar, let's talk. 👉 https://www.know.bi/

[🔭 La vision AGARIC-IG : souveraineté et indépendance] ✅ Depuis sa création, Agaric IG affirme un engagement fort en faveur de la souveraineté numérique et de l’indépendance technologique. 🌐 un hébergement européen avec Hetzner pour les applications de nos clients ou nos solutions internes 🐧 le développement de nos solutions sous #Linux, un système robuste et libre qui favorise la pérennité et l’adaptabilité des outils 🗂 l’organisation et le partage des documents sur Nextcloud en interne 🧩 l’utilisation du meilleur des SIG open source pour concevoir des projets cartographiques performants, durables et pleinement maîtrisés #GeoServer Apache Hop #PostgreSQL #PostGIS #MViewer ... Pour nous, le contexte du projet guidera toujours le choix des technologies open source les plus pertinentes !