etl - Pentaho - Having multiple Copy rows to result results in Get rows from result empty -


i'm trying process data , store in datawarehouse. doing it, wanted store dimensions in 1 transformation , fact (only have one) in transformation. can use job execute first one, copy rows result , them second transformation.

in first transformation, read excel file , separate data streams. data baptism, have 1 stream person, 1 parents, 1 sponsors, , on... @ end of each stream, insert data database , return pk autogenerated (it id autoincrement).

in second one, have get rows result , want set them txt file (just see been done correctly). problem file created empty. suppose if let fields in get rows result empty, gets fields.

what doing wrong?

at end want have 1 copy rows result @ end of each stream in first transformation , data in second one.

enter image description here

in "insert pare padrina" return id_pare_padrina autogenerated, , same "insert mare padrina" (i have more streams have include them result). transformation not executed per row because need values of other rows.

thank you!

in order pass data first transformation second transformation, need set parameters like:

1. first of all, in transformation settings of second transformation (at job level), check on items image below:

enter image description here

copy previous results parameters ensure results/data in "copy rows result" step getting passed next level.

execute every input row : execute second transformation every rows in first transformation file. optional based on requirement.

2. in same transformation settings, define "parameters" in parameters tabs. check image below:

enter image description here

here, name parameter have defined. when using "get rows result", can define these parameter names.

3. instead of using "get rows result", can alternately use "get variables" step fetch variables coming previous step. need define parameter names inside ktr file (ctrl + t). (actually have practically implemented in fashion , worked me.)

4. since "copy rows result" step uses heap memory, defining multiple instances of step might exhaust memory space , code might fall in trouble. ideally use single instance of step.

but if data interation 1 row, best option use "set variables" step.

i assume might have missed of these sections in job.

you can read more on copy rows result in here.

hope helps :)


-

Comments

Post a Comment

Popular posts from this blog

css - SVG using textPath a symbol not rendering in Firefox -

using textpath within symbol doesn't render in firefox. renders fine in latest chrome , ie, when try reference symbol, svg text doesn't render in firefox (37.0.1) - first box appears empty. code below (no external dependencies), there should 2 boxes word test flowing vertically in centre of each. edit: thought issue somehow involved flexbox layout, until paul pointed out issue exists without flexbox layout. the html is: <div> <svg id="not_working" viewbox="0 0 250 1200" preserveaspectratio="xmidymid meet"> <symbol id="test_symbol1" preserveaspectratio="xmidymid meet" viewbox="0 0 250 1200"> <path id="test_symbol_path" d="m 100 1200 l 100 0" /> <text font-size="100" fill="red"> <textpath text-anchor="middle" startoffset="50%" xlink:href="#test_symbol_path...
Read more

Java 8 + Maven Javadoc plugin: Error fetching URL -

i attempting generate javadoc links javadoc dependencies. have tried various means generate javadoc not produce qualified class names references classes dependencies. wanted links java doc simplified class names. however, java api classnames, no links , have qualified class names. working java 8. have following configuration: <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-javadoc-plugin</artifactid> <version>2.10.2</version> <configuration> <reportoutputdirectory>${project.basedir}/target</reportoutputdirectory> <destdir>javadoc</destdir> <windowtitle>epiphany</windowtitle> <doctitle>epiphany</doctitle> <show>private</show> <detectlinks>false</detectlinks> <detectoffline...
Read more

datatable - Matlab struct computations -

i download data yahoo! finance with: data = getyahoodailydata({'msft', 'axp'},'01/01/2000', '01/01/2015', 'dd/mm/yyyy'); and data stored 1x1 struct. want create tx2 matrix of daily adjusted closing prices msft , axp, column 7 in each table in struct. how can that? or better : there way make computations directly on information/prices in struct? you can access data in struct name. vecmsftadj = data.msft.adjclose; vecaxpadj = data.axp.adjclose; % if want n x 2 matrix madjclose = [vecmsftadj, vecaxpadj]; % personnaly prefer working table tadjclose = table; tadjclose.msftadj = vecmsftadj; tadjclose.axpadj = vecaxpadj;
Read more