{"id":1361,"date":"2016-02-24T16:02:52","date_gmt":"2016-02-24T21:02:52","guid":{"rendered":"https:\/\/solutionsreview.com\/data-integration\/?p=1361"},"modified":"2016-10-05T10:59:17","modified_gmt":"2016-10-05T14:59:17","slug":"apache-software-announces-arrow-a-top-level-project","status":"publish","type":"post","link":"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/","title":{"rendered":"Apache Software Announces Arrow; a Top-Level Project"},"content":{"rendered":"

\"Arrow\"<\/p>\n

In a recent press release<\/a>, the Apache Software Foundation announced a new top level project – Apache Arrow. According to the company, Arrow is a high-performance cross-system data layer for columnar in-memory analytics. Arrow will provide accelerated performance of analytical workloads, in some cases by more than 100 times. In addition, the Big Data tool will enable multi-system workloads by eliminating cross-system overhead communication.<\/p>\n

Arrow was initially seeded by code from another project named Apache Drill. However, Arrow was built on top of a number open source collaborations and establishes a de facto standard for columnar in-memory processing and interchange. Code committers to Apache Arrow include developers from a variety of other Big Data projects including Calcite, Cassandra, Drill, Hadoop, HBase, Impala, Phoenix, Spark and others.<\/p>\n

Jacques Nadeau, Vice President of Apache Arrow and Vice Presidet of Apache Drill, adds: “The Open Source community has joined forces on Apache Arrow.\u00a0Developers from 13 major Open Source Big Data projects are already on board –by introducing a new era of columnar in-memory analytics, we anticipate the majority of the world’s data will be processed through Arrow within the next few years.”<\/p>\n

In many workloads, 70 to 80 percent of CPU cycles are spent serializing and deserializing data. Apache Arrow solves this problem by enabling data to be shared between systems and processes with no serialization, deserialization or memory copies. Arrow also supports complex data with dynamic schemas. An example of this would be JSON data which is commonly used in IoT workloads, modern applications and log files. Implementations are also available for a number of programming languages including Java, C++ and Python to allow greater interoperability among a number of Big Data solutions.<\/p>\n

Parth Chandra, member of the Apache Arrow and Apache Drill Project Management Committees, notes: “Real world use cases often include complex combinations of structured and rapidly growing complex-data. Already tested with Apache Drill, the efficient in-memory columnar representation and processing in Arrow will enable users to enjoy the performance of columnar processing with the flexibility of JSON.”<\/p>\n

You can witness Apache Arrow live in the wild at this year’s Strata+ Hadoop World<\/a> in sunny San Jose California in March.<\/p>\n

For Apache’s full press release, click here.<\/a><\/p>\n
Widget not in any sidebars
\n","protected":false},"excerpt":{"rendered":"

In a recent press release, the Apache Software Foundation announced a new top level project – Apache Arrow. According to the company, Arrow is a high-performance cross-system data layer for columnar in-memory analytics. Arrow will provide accelerated performance of analytical workloads, in some cases by more than 100 times. In addition, the Big Data tool […]<\/p>\n","protected":false},"author":23,"featured_media":1362,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[3],"tags":[200,281],"acf":[],"yoast_head":"\nApache Software Announces Arrow; a Top-Level Project<\/title>\n<meta name=\"description\" content=\"In a recent\u00a0press release, the Apache Software Foundation announced a new top level project - Apache Arrow.\u00a0\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tim King\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/\"},\"author\":{\"name\":\"Tim King\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\"},\"headline\":\"Apache Software Announces Arrow; a Top-Level Project\",\"datePublished\":\"2016-02-24T21:02:52+00:00\",\"dateModified\":\"2016-10-05T14:59:17+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/\"},\"wordCount\":378,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#organization\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/oie_2420619A90If9i4.png\",\"keywords\":[\"Apache\",\"Apache Arrow\"],\"articleSection\":[\"Data Integration News\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/\",\"name\":\"Apache Software Announces Arrow; a Top-Level Project\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/oie_2420619A90If9i4.png\",\"datePublished\":\"2016-02-24T21:02:52+00:00\",\"dateModified\":\"2016-10-05T14:59:17+00:00\",\"description\":\"In a recent\u00a0press release, the Apache Software Foundation announced a new top level project - Apache Arrow.\u00a0\",\"breadcrumb\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/#primaryimage\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/oie_2420619A90If9i4.png\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/oie_2420619A90If9i4.png\",\"width\":800,\"height\":350},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/solutionsreview.com\/data-integration\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Apache Software Announces Arrow; a Top-Level Project\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#website\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/\",\"name\":\"Best Data Integration Vendors, News & Reviews for Big Data, Applications, ETL and Hadoop\",\"description\":\"Data Integration Buyers Guide and Best Practices\",\"publisher\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/solutionsreview.com\/data-integration\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#organization\",\"name\":\"Solutions Review\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png\",\"width\":225,\"height\":90,\"caption\":\"Solutions Review\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\",\"name\":\"Tim King\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg\",\"caption\":\"Tim King\"},\"description\":\"Tim is Solutions Review's Executive Editor and leads coverage on data management and analytics. A 2017 and 2018 Most Influential Business Journalist and 2021 \\\"Who's Who\\\" in Data Management, Tim is a recognized industry thought leader and changemaker. Story? Reach him via email at tking@solutionsreview.com.\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/author\/timking\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Apache Software Announces Arrow; a Top-Level Project","description":"In a recent\u00a0press release, the Apache Software Foundation announced a new top level project - Apache Arrow.\u00a0","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/","twitter_misc":{"Written by":"Tim King","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/#article","isPartOf":{"@id":"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/"},"author":{"name":"Tim King","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c"},"headline":"Apache Software Announces Arrow; a Top-Level Project","datePublished":"2016-02-24T21:02:52+00:00","dateModified":"2016-10-05T14:59:17+00:00","mainEntityOfPage":{"@id":"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/"},"wordCount":378,"commentCount":0,"publisher":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#organization"},"image":{"@id":"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/#primaryimage"},"thumbnailUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/oie_2420619A90If9i4.png","keywords":["Apache","Apache Arrow"],"articleSection":["Data Integration News"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/","url":"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/","name":"Apache Software Announces Arrow; a Top-Level Project","isPartOf":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#website"},"primaryImageOfPage":{"@id":"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/#primaryimage"},"image":{"@id":"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/#primaryimage"},"thumbnailUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/oie_2420619A90If9i4.png","datePublished":"2016-02-24T21:02:52+00:00","dateModified":"2016-10-05T14:59:17+00:00","description":"In a recent\u00a0press release, the Apache Software Foundation announced a new top level project - Apache Arrow.\u00a0","breadcrumb":{"@id":"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/#primaryimage","url":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/oie_2420619A90If9i4.png","contentUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/oie_2420619A90If9i4.png","width":800,"height":350},{"@type":"BreadcrumbList","@id":"https:\/\/solutionsreview.com\/data-integration\/apache-software-announces-arrow-a-top-level-project\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/solutionsreview.com\/data-integration\/"},{"@type":"ListItem","position":2,"name":"Apache Software Announces Arrow; a Top-Level Project"}]},{"@type":"WebSite","@id":"https:\/\/solutionsreview.com\/data-integration\/#website","url":"https:\/\/solutionsreview.com\/data-integration\/","name":"Best Data Integration Vendors, News & Reviews for Big Data, Applications, ETL and Hadoop","description":"Data Integration Buyers Guide and Best Practices","publisher":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/solutionsreview.com\/data-integration\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/solutionsreview.com\/data-integration\/#organization","name":"Solutions Review","url":"https:\/\/solutionsreview.com\/data-integration\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/","url":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png","contentUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png","width":225,"height":90,"caption":"Solutions Review"},"image":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c","name":"Tim King","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/image\/","url":"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg","contentUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg","caption":"Tim King"},"description":"Tim is Solutions Review's Executive Editor and leads coverage on data management and analytics. A 2017 and 2018 Most Influential Business Journalist and 2021 \"Who's Who\" in Data Management, Tim is a recognized industry thought leader and changemaker. Story? Reach him via email at tking@solutionsreview.com.","url":"https:\/\/solutionsreview.com\/data-integration\/author\/timking\/"}]}},"_links":{"self":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/posts\/1361"}],"collection":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/comments?post=1361"}],"version-history":[{"count":0,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/posts\/1361\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/media\/1362"}],"wp:attachment":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/media?parent=1361"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/categories?post=1361"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/tags?post=1361"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}