Other Dataset Options

There are a few additional options available when setting up a dataset. They are exposed by opening the Extra Configuration option at the bottom.

Most Recent Only

If this checkbox is selected, Scoop will retain only the most recent report loaded. It will discard any previous data and the dataset will consist only of data from the latest report. If your dataset is simple and entirely contained in a single report, this may be a good option.

Incremental

Sometimes datasets can be very large. In the case of snapshot datasets that could mean very large reports each day with every item you are tracking. However often, most of the items do not change day to day. Therefore, with some slight modifications to the filters on your source report, you can opt to just include in your report only the records that changed that day. In many cases that will dramatically shrink the size of your report. Scoop will then construct the snapshot by using the changed records in your report and adding to them any unchanged records from the prior snapshot (basically records belonging to all the unique keys that are not in the current incremental change report). This can result is faster processing.

Multiple Loads Per Day

If Scoop receives two reports for the same dataset on the same day, the default behavior is to use only the data from the latest report. This way, you can update your data intra-day if you like. However, there are cases where you might want to bring multiple reports into the same dataset on the same day and retain all the data. A possible example is a similar report from two different applications that you want to blend into a single dataset. If that is the case, check this box.