User Tools

Site Tools


09.07.2024

<html> <div style=“font-size:xx-large; font-weight: 900;”>09.07.2024 Dienstag</div> </html>

Kalender, Juli, KW28

Appointments

  • None

Health

  • - Exercises
    • - Rücken
      • - Morgens
      • - Abends
    • - Augen
      • - Morgens
      • - Abends
    • - Zunge
      • - Morgens
      • - Abends
    • - Pr
      • - Morgens
      • - Abends

Tasks for the day

    • - create / change following projects because of new vars / new PLS
      • - Stuttgart
        • + Ditzingen (15 vars)
          • + move output to S:
        • - FeuerbachBotnang (58 vars)
          • - move output to S:
          • + #RRB_Colmarer_Strasse
            • + S94466CL101=wskam1_colm_pls
            • + S94466CL102=wskam2_colm_pls
            • + S94466CL103=wsrrk_colm_pls
          • + #RUEB_Bachschule
            • + S94560CF100=wsdf_bach_pls
            • + S94560CF620=wsvorfluter_bach_pls
            • + S94560CL100=wsbe_bach_pls
            • + S94560CL170=wsak_bach_pls
            • + S94560AA100=wsreg_bach_pls
          • + #RUEB_Bottwarstrasse
            • + S94566AA100=reg_bott_pls
            • + S94566CF100=wsdf_bott_pls
            • + S94566CF600=wskue_bott_pls
            • + S94566CF601=wsbue_bott_pls
            • + S94566CL100=wsbe_bott_pls
            • + S94566CL400=wsvor_bott_pls
          • + #RUEB_Feuerbacher_Weg
            • + S94580AA100=wsreg_feuer_pls
            • + S94580CF100=wsdf_feuer_pls
            • + S94580CF610=wsrech_feuer_pls
            • + S94580CL100=wsbe_feuer_pls
            • + S94580CL170=wsak_feuer_pls
          • + #RUEB_Friedrichswahl
            • + S94584CL101=wsrueb1_fried_pls
            • + S94584CL102=wsrueb2_fried_pls
            • + S94584CF601=wsbue1_fried_pls
            • + S94584CF602=wsbue2_fried_pls
          • + #RUEB_Laihle
            • + S94620CF601=uerueb1_lai_pls
              • only 0 values!
            • + S94620CF602=uerueb2_lai_pls
              • only 0 values!
            • + S94620CL101=einrueb1_lai_pls
              • only 0 values!
            • + S94620CL102=einrueb2_lai_pls
              • only 0 values!
          • + #RUEB_Regerstrasse
            • + S94644CL100=wsbe_reg_pls
            • + S94644CL170=wsak_reg_pls
            • + S94644CF600=wsbue_reg_pls
          • + #RUEK_Borsigstrasse
            • + S94564AA100=regoeff_bor_pls
            • + S94564AA101=drossel1_bor_pls
            • + S94564AA102=drossel2_bor_pls
            • + S94564AA103=drossel3_bor_pls
            • + S94564AA104=drossel4_bor_pls
            • + S94564CF100=wsdf_bor_pls
            • + S94564CF620=wsrech_bor_pls
            • + S94564CL100=uebau_bor_pls
            • + S94564CL101=kammer1_bor_pls
            • + S94564CL102=kammer2_bor_pls
            • + S94564CL103=kammer3_bor_pls
            • + S94564CL104=kammer4_bor_pls
            • + S94564CL105=kammer5_bor_pls
            • + S94564CL170=wsak_bor_pls
          • + #RUEK_Dornbirner_Strasse
            • + S94573CL100=wsbe_dorn_pls
          • + #RUEK_Stadtbad
            • + S94660CL100=wsbe_stadt_pls
            • + S94660CL170=wsab_stadt_pls
            • + S94660CF100=df_stadt_pls
            • + S94660CF610=ent_stadt_pls
            • + S94660CF611=ent1_stadt_pls
            • + S94660CF612=ent2_stadt_pls
            • + S94660CF613=ent3_stadt_pls
            • + S94660CF614=ent4_stadt_pls
            • + S94660CF615=ent5_stadt_pls
            • + S94660AA100=regl_stadt_pls
            • + S94660CG671=ruckstau1_stadt_pls
            • + S94660CG672=ruckstau2_stadt_pls
            • + S94660CG673=ruckstau3_stadt_pls
        • - HedelfingenWangen (52 vars)
          • - move output to S:
          • + #PW_RRK_Am_Westkai
            • + S94804CL100=wsbe_westkai_pls
          • + #RUEB_Gustav-Barth-Strasse
            • + S94588CL100=wsbe_gus_pls
            • + S94588CF600=wsbue_gus_pls
          • + #RUEB_Hedelfinger_Platz
            • + S94592CF100=df_hedel_pls
            • + S94592CF600=ent_hedel_pls
            • + S94592CL100=wsbe_hedel_pls
            • + S94592CL170=wsab_hedel_pls
            • + S94592CL171=wstb_hedel_pls
            • + S94592CL670=wsbue_hedel_pls
            • + S94592AA100=rs_hedel_pls
              • only 0 values!
          • + #RUEB_Hohe_Halde
            • + S94599CF600=wsbue_hohe_pls
            • + S94599CL100=wsbe_hohe_pls
          • + #RUEB_Inselstrasse
            • + S94607CF600=kue_insel_pls
              • only 0 values!
            • + S94607CF620=wsbue_insel_pls
              • only 0 values!
            • + S94607CL100=wsbe_insel_pls
            • + S94607CL170=wsak_insel_pls
          • + #RUEB_Lederbergweg
            • + S94622CF500=reg_leder_pls
            • + S94622CF600=wsbue_leder_pls
            • + S94622CL100=wsbe_leder_pls
            • + S94622CL170=wsak_leder_pls
          • + #RUEB_Madenstrasse
            • + S94632CL100=wsbe_mad_pls
            • + S94632CF100=wsdf_mad_pls
            • + S94632CF600=wsbue_mad_pls
            • + S94632AA100=wsreg_mad_pls
          • + #RUEB_Tiefenbachstrasse
            • + S94668AA100=wsreg_tief_pls
            • + S94668CF100=wsdf_tief_pls
            • + S94668CF610=wsrech_tief_pls
            • + S94668CL100=wsbe_tief_pls
            • + S94668CL170=wsab_tief_pls
          • + #RUEB_PW_Tuttlinger_Strasse
            • + S94669CL100=wsbe_tutt_pls
            • + S94669CF100=wsak_tutt_pls
            • + S94669CF101=df_tutt_pls
            • + S94669CF610=wsrech_tutt_pls
            • + S94669AA100=wsreg_tutt_pls
          • + #RUEK_Nellinger_Strasse
            • + S94639AA100=wsreg_nell_pls
            • + S94639CF102=df_nell_pls
            • + S94639CF601=wsbue_nell_pls
            • + S94639CF610=wsrech_nell_pls
            • + S94639CL100=wsbe_nell_pls
          • + #RUEK_PW_Neckarhafen
            • + S94637CF100=wsdf_neckar_pls
            • + S94637CF600=wsbue_neckar_pls
            • + S94637CL100=wsbe_neckar_pls
            • + S94637CL110=wspusu_neckar_pls
            • + S94637CL131=einspk_neckar_pls
          • + #RUEK_Rohrackerstrasse
            • + S94650CF601=wsbue_rohr_pls
            • + S94650CF610=wsrech_rohr_pls
            • + S94650CL100=wsbe_rohr_pls
            • + S94650CL170=wsak_rohr_pls
          • + #RUEK_Schwendestrasse
            • + S94656AA100=reg_schwend_pls
            • + S94656CF100=df_schwend_pls
            • + S94656CF610=vor_schwend_pls
              • only 0 values!
            • + S94656CL100=wsstauraum_schwend_pls
        • - Moehringen (37 vars)
          • - move output to S:
          • + #RUEB_Dinghofstrasse
            • + S94572CF600=rueb_dingh_beckue_pls
            • + S94572CL100=rueb_dingh_beckein_pls
          • + #RUEB_Gruendgensstrasse
            • + S94586CL100=rueb_grue_beckein_pls
            • + S94586CL170=rueb_grue_nach_pls
            • + S94586CL171=rueb_grue_ver_pls
            • + S94586CL671=rueb_grue_beckue1_pls
            • + S94586CL672=rueb_grue_beckue2_pls
            • + S94586AA100=rueb_grue_reg_pls
              • only 0 values!
            • + S94586CF100=rueb_grue_df_pls
          • + #RUEB_Kauslerweg
            • + S94608CF600=rueb_kaus_2beckue_pls
            • + S94608CL100=rueb_kaus_2beckein_pls
          • + #RUEB_Logauweg
            • + S94872CF600=rueb_logau_klae_pls
            • + S94872CF601=rueb_logau_beckue_pls
            • + S94872CL100=rueb_logau_beckein_pls
            • + S94872CL110=rueb_logau_einpu_pls
          • + #RUEB_Robert-Koch-Strasse
            • + S94647CL100=rueb_rks_einrueb_pls
            • + S94647CL300=rueb_rks_einrrb_pls
            • + S94647CF651=rueb_rks_beckue1_pls
            • + S94647CF652=rueb_rks_beckue2_pls
            • + S94647AA100=rueb_rks_reoe_pls
          • + #RUEB_Ruppmannstrasse
            • + S94653CL100=rueb_rupp_2beckein_pls
            • + S94653CF600=rueb_rupp_2beckue_pls
            • + S94653CF610=rueb_rupp_2entrech_pls
            • + S94653CF631=rueb_rupp_2entstau_pls
          • + #RUEB_Spitalgarten
            • + S94658AA100=rueb_spga_reg_pls
            • + S94658CF600=rueb_spga_beckue_pls
            • + S94658CL100=rueb_spga_beckein_pls
          • + #RUEB_Untere_Koerschmuehle
            • + S94673CF600=rueb_unkoe_beckue_pls
            • + S94673CL100=rueb_unkoe_beckein_pls
          • + #RUEB_Vollmoellerstrasse
            • + S94675CL100=rueb_voll_2beckein_pls
            • + S94675CF611=rueb_voll_2entl1_pls
            • + S94675CF612=rueb_voll_2entl2_pls
          • + #RUEK_Im_Schiessgaertle
            • + S94606AA100=reg_schie_pls
            • + S94606CF100=df_schie_pls
            • + S94606CF610=vor_schie_pls
            • + S94606CL100=wsbe_schie_pls
            • + S94606CL170=wsab_schie_pls
        • - OberUntertuerkheim (21 vars)
        • - OberhalbSchwanenplatz (25 vars)
        • - OberhalbZazenhausen (8 vars)
        • - Plieningen (52 vars)
          • + #RUEB_Aulendorfer_Strasse
            • + S94556CL100=rueb_aulen_estau_pls
            • + S94556CL111=wspusu1_aulen_pls
            • + S94556CL112=wspusu2_aulen_pls
            • + S94556CF611=rueb_aulen_ueblf_pls
            • + S94556CF612=wsku_aulen_pls
            • + S94556CF621=ent1_aulen_pls
            • + S94556CF622=ent2_aulen_pls
            • + S94556CF623=ent3_aulen_pls
            • + S94556CF624=ent4_aulen_pls
          • + #RUEB_Birkacher_Strasse
            • + S94562CL100=rueb_birkacher_estau_pls
            • + S94562CF601=rueb_birkacher_ueblf_pls
            • + S94562CF602=wsku_birkacher_pls
            • + S94562CF610=rueb_birkacher_rechen_pls
          • + #RUEB_Filderhauptstrasse
            • + S94581CL100=rueb_filder_estau_pls
            • + S94581CF600=rueb_filder_ueblf_pls
            • + S94581CF100=rueb_filder_df_pls
            • + S94581AA100=rueb_filder_reg_pls
          • + #RUEK_Guts-Muths-Weg
            • + S94587CF600=rueb_guts_ueblf_pls
            • + S94587CL100=rueb_guts_estau_pls
          • + #RUEB_Hoffeldstrasse
            • + S94596AA100=reg_hof_pls
            • + S94596CF600=rueb_hof_ueblf_pls
            • + S94596CF610=rueb_hof_rechen_pls
            • + S94596CL100=rueb_hof_estau_pls
          • + #RUEK_Koenigsweg
            • + S94611CL100=rueb_kweg_estau_pls
            • + S94611CL670=rueb_kweg_ueblf_pls
            • + S94611CF610=rueb_kweg_rechen_pls
          • + #RUEK_Mittlere_Filderstrasse
            • + S94635CL100=rueb_mifi_estau_pls
            • + S94635CL160=wsvergleich_mifi_pls
            • + S94635CL170=wsab_mifi_pls
            • + S94635CF600=rueb_mifi_ueblf_pls
            • + S94635CF610=ent_mifi_pls
            • + S94635AA100=regl_mifi_pls
          • + #RUEB_Paracelsusstrasse
            • + S94640AA100=regl_para_pls
            • + S94640CF100=df_para_pls
            • + S94640CF611=entvor_para_pls
            • + S94640CF612=entvor1_para_pls
            • + S94640CL100=wsbe_para_pls
            • + S94640CL131=wsspul1_para_pls
            • + S94640CL132=wsspul2_para_pls
            • + S94640CL170=wsab_para_pls
          • + #RUEB_Streitaecker
            • + S94664AA100=regl_streit_pls
            • + S94664CF600=rueb_streit_ueblf_pls
            • + S94664CF610=rueb_streit_rechen_pls
            • + S94664CL100=rueb_streit_estau_pls
          • + #RUEB_Zettach
            • + S94688CF600=rueb_zett_ueblf_pls
              • only 0 values!
            • + S94688CF610=rueb_zett_rechen_pls
            • + S94688CL100=rueb_zett_estau_pls
          • + #RUEK_Eichenhain
            • + S94576AA100=regl_eichen_pls
            • + S94576CF100=df_eichen_pls
            • + S94576CF610=ent_eichen_pls
            • + S94576CL100=rueb_eichen_estau_pls
            • + S94576CL170=wsab_eichen_pls
        • - VaihingenKaltental (20 vars)
        • - VorHKWMuehlhausen (51 vars)
        • - VorZuckerbergstollenLinksN (33 vars)
        • - VorZuckerbergstollenRechtsN (13 vars)
        • - MobileSonden (4 vars)
      • + Baden-Baden
      • - Freudenstadt
        • create new project, because “freudenstadtDornstetten” is something different
        • PLS: Schraml AQUASYS
        • 21 vars:
          • + Betriebsmeldungen
            • + pu1_zwiesel→ D - 800002 - Betrieb Doppelanlage PU1→ B
            • + pu2_zwiesel→ D - 800003 - Betrieb Doppeltanlage PU2→ D
            • + pu3_zwiesel→ D - 800004 - Betrieb Einzelpumpe→ F
            • + pu1_rueb6→ D - 1000002 - RUEB 6 Betrieb Pumpe 1→ H
            • + pu2_rueb6→ D - 1000003 - RUEB 6 Betrieb Pumpe 2→ J
            • + rech1_rueb5→ D - 1100003 - RUEB 5 Feinsiebmodul 1 Betrieb→ N
            • + rech2_rueb5→ D - 1100004 - RUEB 5 Feinsiebmodul 2 Betrieb→ P
            • + pu1_lauter→ D - 1400002 - PW RUEB 1 Betrieb Pumpe 1→ R
            • + pu2_lauter→ D - 1400003 - PW RUEB 1 Betrieb Pumpe 2→ T
          • + RUEB_Oberer_Zwieselberg
            • + wsbe_zwiesel→ A - 800001 - Niveau alte KA→ B
            • + wsbe_uzwiesel→ A - 900001 - Niveau→ D
          • + RUEB1_Lauterbad
            • + wsbe_lauter→ A - 1400001 - PW RUEB 1 Niveau→ B
            • + druck_lauter→ A - 1400002 - PW RUEB 1 Druck Lauterbad→ D
          • - RUEB3_unterhalb_Manbachsiedlung
            • - wsbe_rueb3→ A - 1200001 - RUEB 3 Niveau→ B
          • - RUEB4_Glashuettenweg
            • - wsbe_rueb4→ A - 1100001 - RUEB 4 BUE→ B
          • - RUEB5_Erlenweg
            • - wsbe_rueb5→ A - 1100003 - RUEB 5 BUE5 vor Rechen→ B
            • - wssk_rueb5→ A - 1300002 - RUEB 5 Pumpenschacht Niveau→ D
          • - RUEB6_Gaswerk
            • - wsbe_rueb6→ A - 1000001 - RUEB 6 Niveau→ B
            • - wstb_rueb6→ A - 1000004 - RUEB 6 Niveau Trennbauwerk→ D
          • - RUEB11_Alte_KA
            • - wsbe_rueb11→ A - 1200003 - RUEB 11 Niveau→ B
          • - Zulauf_KA
            • - zulauf_ka→ A - 6 - ZL1MF01 Zulaufmessung→ B
      • - Friedrichshafen (Pannach)
        • 11 vars
      • - Nürtingen (nur Acron)
        • 81 vars
        • PLS: Acron?
      • - Winnenden
        • 76 vars
        • Daten nur aus dem Ordner “Protokolle” nehmen
  • - write a “User Guide” for rdconverter
  • - make a small “Project Developer Guide”
  • - Clean up
    • - nuertingen
      • - use “data/in” as input directory
      • - use “vars” directory for configs
    • - nagold
      • - use “data/in” as input directory (make use of recursion!)
      • - check what can be done additionally
  • - extend documentation
    • - CsvPreprocessor
    • - implement Einstaugrenze
      • - Weissach_wsbe_flachtsued_both.csv
        • - add a check for “Einstaugrenze” during calculation of “isPositiveOutlier”
          • - implement isPositiveOutlierStart
            • + implement isFirstPointWithNegativeSlope
          • - implement isPositiveOutlierEnd
            • + implement isLastPointWithNegativeSlope
    • - export single point outlier correction for Freudenstadt project
      • - check corrected data month per month (full year will not work because of small memory)
        • whether valueKorr == value_korr or not
        • - wsbe_rueb3
        • - wsbe_rueb4
        • - wsbe_rueb5
        • - wsbe_rueb6
          • 1 diff:
            • my correction:
              • 2022-06-25 15:40:00;wsbe_rueb6;3,3
            • manual correction:
              • 2022-06-25 15:40:00;wsbe_rueb6;0
        • - wsbe_rueb11
        • - wsbe_zwiesel
    • - check outliers examples
      • - RÜB Flacht Süd wsbe_flachtsued 2023.csv
      • - Gomaringen_wsbe_wittel.csv
      • - Calw_wsbe_wimno.csv → only 1 outlier
      • - Gomaringen_wsbe_mittel.csv
      • - Leonberg_wszu_rueb26.csv
      • - RÜB 4 Glashüttenweg wsbe_rueb4 2022.csv
    • - calculate different maxAllowedSlope for different time intervals in GetSlopeFromOneRowUDF
      • - try to make a “matrix” instead of “only minimums”
    • - try to configure Spark interpreter memory for Freudenstadt project
      • -Xmx16g worked, but: “Output is truncated to 64048000 bytes. Learn more about ZEPPELIN_INTERPRETER_OUTPUT_LIMIT”
        • ⇒ change zeppelin.interpreter.output.limit value in zeppelin-site.xml
    • - refactor GetSlopeFromOneRowUDF
      • - move maxAllowedSlope member to MarkSlopeFromOneRowUDF class
    • - make a Transformer for “Blockdistanz” (see “1.2 Blockdistanz / Einstau Sonde”)
      • - implement HadSlopeMarkerTransformer
        • - check in current implementation
        • - implement MarkAsBetweenNegativeSlopeStartAndPositiveSlopeEndUDF
          • - test
            • - test with data of one year
            • - tests with real data
        • - clean up in HadSlopeMarkerTransformer and in all UDFs used there
          • - simplify getting/marking slopes using only
            • SLOPE_TO_PREVIOUS_COLUMN_NAME_DEFAULT
              • ⇒ getSlopeToPrevious using GetSlopeFromOneRowUDF()
            • SLOPE_TO_NEXT_COLUMN_NAME_DEFAULT
              • ⇒ getSlopeToNext using GetSlopeFromOneRowUDF()
      • - implement SlopeBasedBlankingDistanceDataTransformer
        • - implement ReplaceValuesWithinEntlastungEventUDF properly
          • ??? use gradient (as first solution) ⇒ GradientBasedBlankingDistanceDataTransformer
            • (⇒ it should be not necessary because it is already calculated in HadSlopeMarkerTransformer.BETWEEN_NEGATIVE_SLOPE_START_AND_POSITIVE_SLOPE_END_MARKER_COLUMN_NAME_DEFAULT)
            • ??? check how gradient can be calculated
              • proposal 1:
                • if (start point is near of the maxValue)
                  • if(t2-t1 < X min)
                    • if(slope > 0 && slope > maxSlope)
                      • ⇒ mark as “probableBlockingDistance”
              • proposal 2 (older?):
                • if (start point is near of the maxValue)
                  • if(there was a slope with “speed” ⇐ maxSpeed)
      • - define scenarios
        • Scenario 1. (simple)
          • runter und nach einer Weile wieder hoch
            • Beispiel: Bild 1, zweite Lücke
        • Scenario 2.
          • runter, dann hoch, aber nicht bis zum Anschlag, dann ein paar mal hoch und runter, aber jedes Mal nicht bis zum Anschlag und nur ziemlich später wieder hoch bis zum Anschlag
            • Beispiel: Bild 1, erste Lücke
        • Scenario 3
          • runter, dann relativ stabil, dann aber noch stark nach unten
            • Besipel: Bild 3
        • Scenario 4
          • ask Benjamin
            • letztes Bild im Abschnitt 1.2, letzte Lücke
              • es ist unklar wie die rechte Seite von der Lücke korrigiert wurde
      • - test all defined scenarios
    • - optimize building
      • set jar to “target” of sparktest
    • - create a new project for transformers
    • - test “1.1. Einfache Ausreißer”
      • test data is in /home/vkalaschnikow/Desktop/buero/Entwicklung/Plausibilitätsprogramm/Beispiele Messfehler Datenlücken
    • - implement a graph for our data
      • - find out which graph libs exist
      • - decide how to handle “big data problem”
        • - find out which solutions exist
        • - implement 2-3 options
    • - “data gaps analysis” → SparkTester.getStatsAboutMultipleIntervals()
      • - check statistics possibilities
      • - check reporting possibilities
  • - Anleitung für neue Mitarbeiter
  • - Acron kennenlernen
    • - Acron-Anleitung.docx
    • - Beschreibung Datentransfer.docx
    • Projekte zur Einarbeitung
      • SES
      • Sindelfingen Q3 2023
      • Aalen Q3 2023
  • …
  • …
  • …
    • - Entry Part 5 into my wiki
    • - Summarize Part 6

Task pool

  • - make a plan for Avril
    • - development
    • - sales and marketing

Goals for the week

09.07.2024.txt · Last modified: by kalaschnikow