KW19 06.05.2024 - 12.05.2024

06.05.2024 Montag
07.05.2024 Dienstag
08.05.2024 Mittwoch
09.05.2024 Donnerstag
10.05.2024 Freitag
11.05.2024 Samstag
12.05.2024 Sonntag

• datachecker
  • - start with implementation of data correctors (see Beispiele für Messfehler und Datenlücken.docx)
    • - implement “Blanking Distance”
      • + implement MarkAsBetweenNegativeSlopeStartAndPositiveSlopeEndUDF
      • + performance problems during loading of one year data
        • fixed with:
          • Window made smaller :
            • WindowSpec windowSpecDesc = … rowsBetween(1, 2);
            • instead of:
            • WindowSpec windowSpecDesc = … rowsBetween(1, Window.unboundedFollowing());
          • increased memory:
            • for Spark interpreter
            • for Zeppelin
      • - do further implementing of blanking distance