Biz/Data11 Apache NiFi 둘러보기 Table of ContentsWhat is Apache NiFi?The core concepts of NiFiNiFi ArchitecturePerformance Expectations and Characteristics of NiFiHigh Level Overview of Key NiFi FeaturesReferencesWhat is Apache NiFi?Put simply NiFi was built to automate the flow of data between systems. While the term dataflow is used in a variety of contexts, we’ll use it here to mean the automated and managed flow of informa.. 2016. 3. 26. Apache NiFi 시작하기 Table of ContentsWho is This Guide For?Terminology Used in This GuideDownloading and Installing NiFiStarting NiFi For Windows UsersFor Linux/Mac OSX usersInstalling as a ServiceI Started NiFi. Now What? Adding a ProcessorConfiguring a ProcessorConnecting ProcessorsStarting and Stopping ProcessorsGetting More Info for a ProcessorOther ComponentsWhat Processors are Available Data TransformationRou.. 2016. 3. 26. Stream Processing: NiFi and Spark Without doubt, Apache Spark has become wildly popular for processing large quantities of data. One of the key features that Spark provides is the ability to process data in either a batch processing mode or a streaming mode with very little change to your code. Batch processing is typically performed by reading data from HDFS. There have been a few different articles posted about using Apache Ni.. 2016. 3. 26. SAP Data Service Script Work Flow 을 제어하든 뭘하든 Script 와 Script 내 SQL 을 사용하게 된다. 실질적인 데이터 적재를 하기전과 후에 스크립트를 활용하는 간단한 예제를 살펴보자 기본 구성은 다음과 같이 Job은 JOB_DeltaLoad_Template 로 하였다. Work Flow는 작업전(WF_DELTA_RPE_RUN), Data Flow 가 있는 WF__deltaDefault , 작업후 WF_DELTA_POST_RUN, 그리고 배치파일이나 기타 필요한 내용을 실행할 WF_USER_POST_RUN을 생성한다. 변수는 다음과 같이 생성한다. 각 스크립트를 살펴보면 ** Pre run ** Post run 2014. 9. 23. 이전 1 2 3 다음
