Alternatives to Querybook logo

Alternatives to Querybook

Visual Studio, IntelliJ IDEA, PyCharm, Android Studio, and Xcode are the most popular alternatives and competitors to Querybook.
2
8
+ 1
0

What is Querybook and what are its top alternatives?

It is a Big Data IDE that allows you to discover, create, and share data analyses, queries, and tables. It's core focus is to make composing queries, creating analyses, and collaborating with others as simple as possible.
Querybook is a tool in the Integrated Development Environment category of a tech stack.
Querybook is an open source tool with GitHub stars and GitHub forks. Here’s a link to Querybook's open source repository on GitHub

Top Alternatives to Querybook

  • Visual Studio

    Visual Studio

    Visual Studio is a suite of component-based software development tools and other technologies for building powerful, high-performance applications. ...

  • IntelliJ IDEA

    IntelliJ IDEA

    Out of the box, IntelliJ IDEA provides a comprehensive feature set including tools and integrations with the most important modern technologies and frameworks for enterprise and web development with Java, Scala, Groovy and other languages. ...

  • PyCharm

    PyCharm

    PyCharm’s smart code editor provides first-class support for Python, JavaScript, CoffeeScript, TypeScript, CSS, popular template languages and more. Take advantage of language-aware code completion, error detection, and on-the-fly code fixes! ...

  • Android Studio

    Android Studio

    Android Studio is a new Android development environment based on IntelliJ IDEA. It provides new features and improvements over Eclipse ADT and will be the official Android IDE once it's ready. ...

  • Xcode

    Xcode

    The Xcode IDE is at the center of the Apple development experience. Tightly integrated with the Cocoa and Cocoa Touch frameworks, Xcode is an incredibly productive environment for building amazing apps for Mac, iPhone, and iPad. ...

  • PhpStorm

    PhpStorm

    PhpStorm is a PHP IDE which keeps up with latest PHP & web languages trends, integrates a variety of modern tools, and brings even more extensibility with support for major PHP frameworks. ...

  • WebStorm

    WebStorm

    WebStorm is a lightweight and intelligent IDE for front-end development and server-side JavaScript. ...

  • Apache Spark

    Apache Spark

    Spark is a fast and general processing engine compatible with Hadoop data. It can run in Hadoop clusters through YARN or Spark's standalone mode, and it can process data in HDFS, HBase, Cassandra, Hive, and any Hadoop InputFormat. It is designed to perform both batch processing (similar to MapReduce) and new workloads like streaming, interactive queries, and machine learning. ...

Querybook alternatives & related posts

Visual Studio logo

Visual Studio

28.8K
22.5K
1K
State-of-the-art tools and services that you can use to create great apps for devices, the cloud, and everything...
28.8K
22.5K
+ 1
1K
PROS OF VISUAL STUDIO
  • 296
    Intellisense, ui
  • 236
    Complete ide and debugger
  • 161
    Plug-ins
  • 99
    Integrated
  • 90
    Documentation
  • 34
    Node tools for visual studio (ntvs)
  • 33
    Fast
  • 28
    Free Community edition
  • 21
    Simple
  • 16
    Bug free
  • 5
    Made by Microsoft
  • 4
    Full free community version
  • 3
    Productivity Power Tools
  • 3
    JetBrains plugins (ReSharper etc.) work sufficiently OK
  • 2
    VIM integration
  • 2
    Vim mode
  • 1
    The Power and Easiness to Do anything in any.. language
  • 1
    I develop UWP apps and Intellisense is super useful
CONS OF VISUAL STUDIO
  • 14
    Bulky
  • 12
    Made by Microsoft
  • 2
    Only avalible on Windows

related Visual Studio posts

Nicholas Rogoff

Secure Membership Web API backed by SQL Server. This is the backing API to store additional profile and complex membership metadata outside of an Azure AD B2C provider. The front-end using the Azure AD B2C to allow 3rd party trusted identity providers to authenticate. This API provides a way to add and manage more complex permission structures than can easily be maintained in Azure AD.

We have .Net developers and an Azure infrastructure environment using server-less functions, logic apps and SaaS where ever possible. For this service I opted to keep it as a classic WebAPI project and deployed to AppService.

  • Trusted Authentication Provider: @AzureActiveDirectoryB2C
  • Frameworks: .NET Core
  • Language: C# , Microsoft SQL Server , JavaScript
  • IDEs: Visual Studio Code , Visual Studio
  • Libraries: jQuery @EntityFramework, @AutoMapper, @FeatureToggle , @Swashbuckle
  • Database: @SqlAzure
  • Source Control: Git
  • Build and Release Pipelines: Azure DevOps
  • Test tools: Postman , Newman
  • Test framework: @nUnit, @moq
  • Infrastructure: @AzureAppService, @AzureAPIManagement
See more
Maria Naggaga
Senior Program Manager - .NET Team at Microsoft · | 7 upvotes · 352.1K views

.NET Core is #free, #cross-platform, and #opensource. A developer platform for building all types of apps ( #web apps #mobile #games #machinelearning #AI and #Desktop ).

Developers have chosen .NET for:

Productive: Combined with the extensive class libraries, common APIs, multi-language support, and the powerful tooling provided by the Visual Studio family ( Visual Studio and Visual Studio Code ), .NET is the most productive platform for developers.

Any app: From mobile applications running on iOS, Android and Windows, to Enterprise server applications running on Windows Server and Linux, or high-scale microservices running in the cloud, .NET provides a solution for you.

Performance: .NET is fast. Really fast! The popular TechEmpower benchmark compares web application frameworks with tasks like JSON serialization, database access, and server side template rendering - .NET performs faster than any other popular framework.

See more
IntelliJ IDEA logo

IntelliJ IDEA

27.5K
21.6K
1.5K
Capable and Ergonomic IDE for JVM
27.5K
21.6K
+ 1
1.5K
PROS OF INTELLIJ IDEA
  • 296
    Fantastically intelligent
  • 243
    Best-in-class ide
  • 190
    Many languages support
  • 155
    Java
  • 121
    Fast
  • 80
    Code analysis
  • 78
    Reliable
  • 76
    Out of the box integration with maven, git, svn
  • 64
    Plugin architecture
  • 61
    Integrated version control
  • 12
    Code refactoring support
  • 10
    Best java IDE
  • 7
    Local history
  • 6
    Integrated Database Navigator
  • 6
    Code Completion
  • 6
    Built-in terminal/run tools
  • 5
    All
  • 5
    Free for open-source development, students and teacher
  • 5
    Free If you're a Student
  • 4
    IDE
  • 4
    Cross platform
  • 4
    Base for Android Studio
  • 4
    ERD Diagrams
  • 4
    Database/Code integration
  • 4
    Kotlin
  • 3
    Typescript support
  • 3
    Server and client-side debugger
  • 3
    Free
  • 3
    More than enough languages for any developer
  • 3
    Multicursor support
  • 3
    Reformating Code
  • 3
    Intuitive
  • 3
    Command-line tools
  • 3
    Android Integration
  • 3
    Out Of The Box features
  • 3
    Vim support
  • 3
    Special icons for most filetypes in project list
  • 3
    Supports many frameworks
  • 3
    Built-in web server
  • 3
    Live Templates
  • 3
    Scala support
  • 2
    File Watchers
  • 2
    Support for various package managers
  • 2
    Integrated Code Linting
  • 2
    Its fake intellisense is better than real IntelliSense
  • 2
    Clean UI
  • 2
    Open source
  • 2
    Column Selection Mode
  • 2
    So modernised
  • 2
    Efficient, one Stop solution
  • 2
    Diff tools
  • 2
    Task managers
  • 2
    Full support
  • 2
    Integrated Ssh/Ftp Managers
  • 2
    Just works
  • 2
    A lot of plugin
  • 2
    Works fine with mac os catalina
CONS OF INTELLIJ IDEA
  • 18
    Large footprint required to really enjoy (mem/disc)
  • 14
    Very slow
  • 7
    Bad for beginners
  • 6
    UI is not intuitive
  • 5
    Not nearly as many tools to integrate as vs code
  • 4
    Constant reindexing
  • 3
    Needs a lot of CPU and RAM power
  • 2
    Doesn't work that well with windows 10 edu
  • 2
    Built in terminal is slow
  • 1
    Ruby is a plug in
  • 0
    AAD

related IntelliJ IDEA posts

christy craemer

UPDATE: Thanks for the great response. I am going to start with VSCode based on the open source and free version that will allow me to grow into other languages, but not cost me a license ..yet.

I have been working with software development for 12 years, but I am just beginning my journey to learn to code. I am starting with Python following the suggestion of some of my coworkers. They are split between Eclipse and IntelliJ IDEA for IDEs that they use and PyCharm is new to me. Which IDE would you suggest for a beginner that will allow expansion to Java, JavaScript, and eventually AngularJS and possibly mobile applications?

See more
Andrey Kurdyumov
Sr. Software developer · | 6 upvotes · 246K views

I use Visual Studio because it provides me best default configuration for development. Less choice helps me concentrate on the product. In a sense it is iPhone of software development for me. When my laptop broke, I just download latest version of VS and start coding without any configuration. For sure it has best editor in terms of perceived responsiveness. Could not say the same for IntelliJ IDEA unfortunately.

See more
PyCharm logo

PyCharm

16.7K
13.3K
423
The Most Intelligent Python IDE
16.7K
13.3K
+ 1
423
PROS OF PYCHARM
  • 105
    Smart auto-completion
  • 88
    Intelligent code analysis
  • 74
    Powerful refactoring
  • 57
    Virtualenv integration
  • 50
    Git integration
  • 20
    Support for Django
  • 9
    Multi-database integration
  • 7
    VIM integration
  • 4
    Vagrant integration
  • 3
    In-tool Bash and Python shell
  • 2
    Docker
  • 2
    Plugin architecture
  • 1
    Debug mode support docker
  • 1
    Perforce integration
CONS OF PYCHARM
  • 7
    Slow startup
  • 4
    Not very flexible
  • 3
    Resource hog
  • 1
    Periodic slow menu response

related PyCharm posts

christy craemer

UPDATE: Thanks for the great response. I am going to start with VSCode based on the open source and free version that will allow me to grow into other languages, but not cost me a license ..yet.

I have been working with software development for 12 years, but I am just beginning my journey to learn to code. I am starting with Python following the suggestion of some of my coworkers. They are split between Eclipse and IntelliJ IDEA for IDEs that they use and PyCharm is new to me. Which IDE would you suggest for a beginner that will allow expansion to Java, JavaScript, and eventually AngularJS and possibly mobile applications?

See more

I am a QA heading to a new company where they all generally use Visual Studio Code, my experience is with IntelliJ IDEA and PyCharm. The language they use is JavaScript and so I will be writing my test framework in javaScript so the devs can more easily write tests without context switching.

My 2 questions: Does VS Code have Cucumber Plugins allowing me to write behave tests? And more importantly, does VS Code have the same refactoring tools that IntelliJ IDEA has? I love that I have easy access to a range of tools that allow me to refactor and simplify my code, making code writing really easy.

See more
Android Studio logo

Android Studio

16.6K
12.4K
355
Android development environment based on IntelliJ IDEA
16.6K
12.4K
+ 1
355
PROS OF ANDROID STUDIO
  • 173
    Android studio is a great tool, getting better and bet
  • 101
    Google's official android ide
  • 35
    Intelligent code editor with lots of auto-completion
  • 25
    Its powerful and robust
  • 5
    Easy creating android app
  • 3
    Amazing Layout Designer
  • 3
    Great Code Tips
  • 3
    Great tool & very helpful
  • 2
    Built in Emulator
  • 2
    Easy to use
  • 2
    Keyboard Shortcuts are Amazing Out of the box
  • 1
    Cc
CONS OF ANDROID STUDIO
  • 4
    Huge memory usage
  • 4
    Slow emulator
  • 2
    No checking incompatibilities
  • 2
    Complex for begginers
  • 1
    Lags behind IntelliJ IDEA
  • 1
    Slow release process

related Android Studio posts

Gustavo Muñoz
Web UI Developer at Globant · | 8 upvotes · 368.4K views

In my modest opinion, Flutter is the future of mobile development. The framework is as important to mobile as React is to the web. And seeing that React Native does not finish taking off, I am focusing all my efforts on learning Flutter and Dart. The ecosystem is amazing. The community is crazy about Flutter. There are enough resources to learn and enjoy the framework, and the tools developed to work with it are amazing. Android Studio or Visual Studio Code has incredible plugins and Dart is a pretty straight forward and easy-to-learn language, even more, if you came from JavaScript. I admit it. I'm in love with Flutter. When you are not a designer, having a framework focused on design an pretty things is a must. And counting with tools like #flare for animations makes everything easier. It is so amazing that I wish I had a big mobile project right now at work just to use Flutter.

See more
Julien DeFrance
Principal Software Engineer at Tophatter · | 8 upvotes · 311K views

As a Engineering Manager & Director at SmartZip, I had a mix of front-end, back-end, #mobile engineers reporting to me.

Sprints after sprints, I noticed some inefficiencies on the MobileDev side. People working multiple sprints in a row on their Xcode / Objective-C codebase while some others were working on Android Studio. After which, QA & Product ensured both applications were in sync, on a UI/UX standpoint, creating addional work, which also happened to be extremely costly.

Our resources being so limited, my role was to stop this bleeding and keep my team productive and their time, valuable.

After some analysis, discussions, proof of concepts... etc. We decided to move to a single codebase using React Native so our velocity would increase.

After some initial investment, our initial assumptions were confirmed and we indeed started to ship features a lot faster than ever before. Also, our engineers found a way to perform this upgrade incrementally, so the initial platform-specific codebase wouldn't have to entirely be rewritten at once but only gradually and at will.

Feedback around React Native was very positive. And I doubt - for the kind of application we had - no one would want to go back to two or more code bases. Our application was still as Native as it gets. And no feature or device capability was compromised.

See more
Xcode logo

Xcode

13.1K
9.3K
209
The complete toolset for building great apps
13.1K
9.3K
+ 1
209
PROS OF XCODE
  • 129
    IOS Development
  • 32
    Personal assistant on steroids
  • 29
    Easy setup
  • 17
    Excellent integration with Clang
  • 1
    Beautiful
  • 1
    Built-in everything
  • 0
    Con
CONS OF XCODE
  • 4
    Massively bloated and complicated for smaller projects
  • 2
    Horrible auto completiting and text editing
  • 1
    Very slow emulator

related Xcode posts

Julien DeFrance
Principal Software Engineer at Tophatter · | 8 upvotes · 311K views

As a Engineering Manager & Director at SmartZip, I had a mix of front-end, back-end, #mobile engineers reporting to me.

Sprints after sprints, I noticed some inefficiencies on the MobileDev side. People working multiple sprints in a row on their Xcode / Objective-C codebase while some others were working on Android Studio. After which, QA & Product ensured both applications were in sync, on a UI/UX standpoint, creating addional work, which also happened to be extremely costly.

Our resources being so limited, my role was to stop this bleeding and keep my team productive and their time, valuable.

After some analysis, discussions, proof of concepts... etc. We decided to move to a single codebase using React Native so our velocity would increase.

After some initial investment, our initial assumptions were confirmed and we indeed started to ship features a lot faster than ever before. Also, our engineers found a way to perform this upgrade incrementally, so the initial platform-specific codebase wouldn't have to entirely be rewritten at once but only gradually and at will.

Feedback around React Native was very positive. And I doubt - for the kind of application we had - no one would want to go back to two or more code bases. Our application was still as Native as it gets. And no feature or device capability was compromised.

See more
Sezgi Ulucam
Developer Advocate at Hasura · | 7 upvotes · 634K views

I've recently switched to using Expo for initializing and developing my React Native apps. Compared to React Native CLI, it's so much easier to get set up and going. Setting up and maintaining Android Studio, Android SDK, and virtual devices used to be such a headache. Thanks to Expo, I can now test my apps directly on my Android phone, just by installing the Expo app. I still use Xcode Simulator for iOS testing, since I don't have an iPhone, but that's easy anyway. The big win for me with Expo is ease of Android testing.

The Expo SDK also provides convenient features like Facebook login, MapView, push notifications, and many others. https://docs.expo.io/versions/v31.0.0/sdk/

See more
PhpStorm logo

PhpStorm

9.7K
7.2K
1.6K
Professional IDE for PHP and Web Developers
9.7K
7.2K
+ 1
1.6K
PROS OF PHPSTORM
  • 285
    Best ide for php
  • 232
    Easy to use
  • 218
    Functionality
  • 164
    Plugins
  • 160
    Code analysis
  • 86
    Integrated version control
  • 74
    Great php ide for mac
  • 72
    All-round php ide
  • 61
    Local history
  • 52
    Themes
  • 16
    Best PHP IDE
  • 11
    Database control
  • 9
    Easy to find anything and everything in your code
  • 8
    Best bebugging
  • 8
    Best inspection variable
  • 6
    Command line integration
  • 6
    UX
  • 6
    Getting Better
  • 6
    PHPUnit integration
  • 6
    Great frameworks integration
  • 6
    Performance
  • 5
    Real time code validation
  • 5
    Easy to use and github interaction
  • 5
    Neat does the job and easy
  • 5
    Coolest IDE
  • 5
    Composer integration
  • 4
    TypeScript support
  • 4
    Best ide for advanced php and symfony
  • 4
    Cross platform
  • 3
    Best ide for php
  • 3
    Code indexing
  • 3
    It has no match. it filled one of the biggest void
  • 3
    Very good
  • 3
    Good
  • 3
    Fast and relevant auto-complete
  • 3
    Great refactoring support
  • 3
    Debugger for Javascript
  • 2
    Awesome debugging features
  • 2
    Perfect locahost / host sync
  • 2
    Debugging in the Just-In-Time Mode
  • 2
    Integration with Vagrant and Docker
CONS OF PHPSTORM
  • 14
    Uses a lot of memory
  • 10
    Does not open large files
  • 9
    Slow
  • 8
    Uses Java machine
  • 3
    No way to change syntax highlight for files without ext
  • 2
    No save prompt or asterisk on file change

related PhpStorm posts

Johnny Bell
Software Engineer at Weedmaps · | 19 upvotes · 541.2K views

I've been in the #frontend game for about 7 years now. I started coding in Sublime Text because all of the tutorials I was doing back then everyone was using it. I found the speed amazing compared to some other tools at the time. I kept using Sublime Text for about 4-5 years.

I find Sublime Text lacks some functionality, after all it is just a text editor rather than a full fledged IDE. I finally converted over to PhpStorm as I was working with Magento and Magento as you know is mainly #PHP based.

This was amazing all the features in PhpStorm I loved, the debugging features, and the control click feature when you click on a dependency or linked file it will take you to that file. It was great.

PhpStorm is kind of slow, I found that Prettier was taking a long time to format my code, and it just was lagging a lot so I was looking for alternatives. After watching some more tutorial videos I noticed that everyone was using Visual Studio Code. So I gave it a go, and its amazing.

It has support for everything I need with the plugins and the integration with Git is amazing. The speed of this IDE is blazing fast, and I wouldn't go back to using PhpStorm anymore. I highly recommend giving Visual Studio Code a try!

See more
Johnny Bell
Software Engineer at Weedmaps · | 11 upvotes · 363.5K views

When I switched to Visual Studio Code 12 months ago from PhpStorm I was in love, it was great. However after using VS Code for a year, I see myself switching back and forth between WebStorm and VS Code. The VS Code plugins are great however I notice Prettier, auto importing of components and linking to the definitions often break, and I have to restart VS Code multiple times a week and sometimes a day.

We use Ruby here so I do like that Visual Studio Code highlights that for me out of the box, with WebStorm I'd need to probably also install RubyMine and have 2 IDE's going at the same time.

Should I stick with Visual Studio Code, or switch to something else? #help

See more
WebStorm logo

WebStorm

8.8K
6.6K
924
The smartest JavaScript IDE
8.8K
6.6K
+ 1
924
PROS OF WEBSTORM
  • 182
    Intelligent ide
  • 123
    Smart development environment
  • 105
    Easy js debugging
  • 94
    Code inspection
  • 92
    Support for the Latest Technologies
  • 52
    Created by jetbrains
  • 50
    Cross-platform ide
  • 35
    Integration
  • 29
    Spellchecker
  • 24
    Language Mixing/Injection
  • 10
    Debugger
  • 9
    Local History
  • 8
    Web developer can't live without this
  • 6
    Fast search
  • 6
    Angular.js support
  • 6
    Git support
  • 5
    Show color on the border next to hex string in CSS
  • 5
    FTP
  • 5
    Smart autocompletion
  • 5
    There is no need to setup plugins (all from the box)
  • 4
    Paid but easy to crack
  • 4
    JSON Schema
  • 4
    Awesome
  • 4
    Sass autocompletion
  • 4
    Built-in js debugger
  • 4
    Running and debugging Node.js apps remotely
  • 4
    Better refactoring options
  • 4
    A modern IDE stuck in the 90s
  • 3
    TypeScript support
  • 3
    Node.js integration
  • 3
    Smart coding assistance for React
  • 3
    111
  • 3
    Protractor support out of the box
  • 3
    Intelligent
  • 3
    Easy to use
  • 2
    Vagrant and SSH Console
  • 2
    Dart support
  • 2
    Solid intelligent features
  • 2
    Docker intergration
  • 2
    Great app
  • 2
    Integrated terminal
  • 1
    Easier to keep running than eclipse
  • 1
    Unused imports inspection
  • 1
    Remote Files Syncronization
  • 1
    Free for students
  • 1
    Grate debug tools for React Apps
  • 1
    Thank you very much
  • 1
    Less autocompletion
  • 1
    Vim support
CONS OF WEBSTORM
  • 4
    Paid
  • 1
    Expensive

related WebStorm posts

Johnny Bell
Software Engineer at Weedmaps · | 11 upvotes · 363.5K views

When I switched to Visual Studio Code 12 months ago from PhpStorm I was in love, it was great. However after using VS Code for a year, I see myself switching back and forth between WebStorm and VS Code. The VS Code plugins are great however I notice Prettier, auto importing of components and linking to the definitions often break, and I have to restart VS Code multiple times a week and sometimes a day.

We use Ruby here so I do like that Visual Studio Code highlights that for me out of the box, with WebStorm I'd need to probably also install RubyMine and have 2 IDE's going at the same time.

Should I stick with Visual Studio Code, or switch to something else? #help

See more
Russel Werner
Lead Engineer at StackShare · | 7 upvotes · 336.7K views

We use Prettier because when we rebooted our front-end stack, I decided that it would be an efficient use of our time to not worry about code formatting issues and personal preferences during peer review. Prettier eliminates this concern by auto-formatting our code to a deterministic output. We use it along with ESLint and have 1st-class support in our WebStorm and Visual Studio Code editors.

See more
Apache Spark logo

Apache Spark

2.3K
2.6K
132
Fast and general engine for large-scale data processing
2.3K
2.6K
+ 1
132
PROS OF APACHE SPARK
  • 58
    Open-source
  • 48
    Fast and Flexible
  • 7
    One platform for every big data problem
  • 6
    Easy to install and to use
  • 6
    Great for distributed SQL like applications
  • 3
    Works well for most Datascience usecases
  • 2
    Machine learning libratimery, Streaming in real
  • 2
    In memory Computation
  • 0
    Interactive Query
CONS OF APACHE SPARK
  • 3
    Speed

related Apache Spark posts

Eric Colson
Chief Algorithms Officer at Stitch Fix · | 21 upvotes · 1.9M views

The algorithms and data infrastructure at Stitch Fix is housed in #AWS. Data acquisition is split between events flowing through Kafka, and periodic snapshots of PostgreSQL DBs. We store data in an Amazon S3 based data warehouse. Apache Spark on Yarn is our tool of choice for data movement and #ETL. Because our storage layer (s3) is decoupled from our processing layer, we are able to scale our compute environment very elastically. We have several semi-permanent, autoscaling Yarn clusters running to serve our data processing needs. While the bulk of our compute infrastructure is dedicated to algorithmic processing, we also implemented Presto for adhoc queries and dashboards.

Beyond data movement and ETL, most #ML centric jobs (e.g. model training and execution) run in a similarly elastic environment as containers running Python and R code on Amazon EC2 Container Service clusters. The execution of batch jobs on top of ECS is managed by Flotilla, a service we built in house and open sourced (see https://github.com/stitchfix/flotilla-os).

At Stitch Fix, algorithmic integrations are pervasive across the business. We have dozens of data products actively integrated systems. That requires serving layer that is robust, agile, flexible, and allows for self-service. Models produced on Flotilla are packaged for deployment in production using Khan, another framework we've developed internally. Khan provides our data scientists the ability to quickly productionize those models they've developed with open source frameworks in Python 3 (e.g. PyTorch, sklearn), by automatically packaging them as Docker containers and deploying to Amazon ECS. This provides our data scientist a one-click method of getting from their algorithms to production. We then integrate those deployments into a service mesh, which allows us to A/B test various implementations in our product.

For more info:

#DataScience #DataStack #Data

See more
Conor Myhrvold
Tech Brand Mgr, Office of CTO at Uber · | 7 upvotes · 963K views

Why we built Marmaray, an open source generic data ingestion and dispersal framework and library for Apache Hadoop :

Built and designed by our Hadoop Platform team, Marmaray is a plug-in-based framework built on top of the Hadoop ecosystem. Users can add support to ingest data from any source and disperse to any sink leveraging the use of Apache Spark . The name, Marmaray, comes from a tunnel in Turkey connecting Europe and Asia. Similarly, we envisioned Marmaray within Uber as a pipeline connecting data from any source to any sink depending on customer preference:

https://eng.uber.com/marmaray-hadoop-ingestion-open-source/

(Direct GitHub repo: https://github.com/uber/marmaray Kafka Kafka Manager )

See more