25.07.2024 Donnerstag
[[Kalender]], [[http://vwiki.wialon-consulting.de/doku.php?id=kalender#juli|Juli]], [[2024KW30|KW30]]\\ ====== Appointments ====== * None ====== Health ====== * **-** Exercises * **-** Rücken * **-** Morgens * **-** Abends * **-** Augen * **-** Morgens * **-** Abends * **-** Zunge * **-** Morgens * **-** Abends * **-** Pr * **-** Morgens * **-** Abends ====== Tasks for the day ====== * **-** [[https://lifehacker.com/work/how-to-choose-the-right-productivity-method|How to Choose the Best Productivity Method for You]] * **-** find out what "RPM" (by Toni Robbins) is * **-** [[rdconverter]] * **-** create / change following projects because of new vars / new PLS * **+** Stuttgart (389 vars) * **+** Baden-Baden * **+** Freudenstadt (21 vars) * **+** Friedrichshafen Pannach (11 vars) * **+** Nürtingen Acron (81 vars) * **+** 81 vars * **+** Auwiesen * **+** Breiter Weg * **+** Gottlieb_Daimler_Strasse * GDS_entlas * sehr komische Daten (mal 0, mal leer) * **+** Groetzinger Strasse * GS_tb * only 0 values * **+** Grosser Forst * **+** Hochwiesen * very big input file => conversion takes very long * HWHW_VG7 * only 0 values * HWHW_VG8 * only 0 values * **+** Hohes Gestade * **+** Humpfenbach * variable "HB_rs" does not exist in Benjamin's output data * "HB_ds" is meaned? (I have it configured in my project) * HB_uber * only 0 values * **+** Laiblinstegstrasse * **+** Muehlstrasse * **+** .bat * **+** Neckarhausen * **+** .bat * **-** Rehwiesen * **+** .bat * REH_.*pump. Problem * ''REH_wspump1'' -> Benjamin, ''REH_pump1'' -> bei mir * ''REH_wspump2'' -> Benjamin, ''REH_pump2'' -> bei mir * wie ist es richtig? * **+** Reudern Ost * **+** fix file name in util/mkdirs (''inputInclude=Reudern.*Ost\\s2.*.csv'') * **+** .bat * o1 * only empty values * o2 * only empty values * **+** Schacht 392 * **+** fix file name in util/mkdirs (''inputInclude=Schacht.*392\\s2.*.csv'') * **+** .bat * some vars not listed (q4.../q5...) * **+** Stadtbruecke * x4, x21 * only 0 and empty values * **+** Steinleswiesen * **+** fix file name in util/mkdirs (''inputInclude=Steinleswiesen\\s2.*.csv'') * **+** .bat * HWSW_VG1, HWSW_VG2 * only 0 values * HWSW_VG3 * only empty values * **+** Unterensinger Strasse * **+** Weberstrasse * WS_ds / WS_rs problem * WS_ds -> bei mir * WS_rs -> bei Benjamin * **+** Zizishausen * p1 * only empty values * **+** Zulauf KA * **+** move output data to ''S:\'' * **-** Winnenden * **-** 76 vars * **+** Zipfelbachtal (31 vars) * **+** RUEB_12_Breuningsweiler * **+** RUEB_13_Koernle * **+** RUEB_14_Albert-Schweitzer-Strasse * **+** RUEB_15_PLK_Sportzentrum * **+** RUEB_16_Hufeisen * **+** RUEB_17_Linsenhalde * **+** RUEB_25_Hanweiler * **+** RUEB_26_Klaeranlage * **-** Buchenbachtal (45 vars) * **-** RUEB_1_Pfeilhof * **-** RUEB_4_Wiesengrund * **-** RUEB_7_Wiesenstrasse * **-** RUEB_8_Friedrichstrasse * **-** RUEB_10_Backnanger_Strasse * **-** RUEB_11_Hungerberg * **-** RUEB_19_Buerg * **-** RUEB_20_Silcherstrasse * **-** RUEB_21_Jahnstrasse * **-** RUEB_22_Talaue * **-** RUEB_24_Wassergraben * **-** RUEB_1006_Zwischen_den_Baechen * ''S:\Datenmanagement\Datendownload\Winnenden'' * Daten nur aus dem Ordner "Protokolle" nehmen * **-** don't convert invalid data (?) * **-** Eutingen im Gäu * 20 vars * ''S:\Datenmanagement\Datendownload\Eutingen im Gäu'' * Daten für 2022 + 2023 + 2024 (bis 23.07.2024 00:00) * **-** write a "User Guide" for rdconverter * **-** make a small "Project Developer Guide" * **-** Clean up * **-** nuertingen * **-** use "data/in" as input directory * **-** use "vars" directory for configs * **-** nagold * **-** use "data/in" as input directory (make use of recursion!) * **-** check what can be done additionally * **-** extend documentation * **-** CsvPreprocessor * **-** [[datachecker]] * **-** implement Einstaugrenze * **-** Weissach_wsbe_flachtsued_both.csv * **-** add a check for "Einstaugrenze" during calculation of "isPositiveOutlier" * **-** implement ''isPositiveOutlierStart'' * **+** implement ''isFirstPointWithNegativeSlope'' * **-** implement ''isPositiveOutlierEnd'' * **+** implement ''isLastPointWithNegativeSlope'' * **-** export single point outlier correction for Freudenstadt project * **-** check corrected data month per month (full year will not work because of small memory) * whether ''valueKorr == value_korr'' or not * **-** wsbe_rueb3 * **-** wsbe_rueb4 * **-** wsbe_rueb5 * **-** wsbe_rueb6 * 1 diff: * my correction: * 2022-06-25 15:40:00;wsbe_rueb6;3,3 * manual correction: * 2022-06-25 15:40:00;wsbe_rueb6;0 * **-** wsbe_rueb11 * **-** wsbe_zwiesel * **-** check outliers examples * **-** RÜB Flacht Süd wsbe_flachtsued 2023.csv * **-** Gomaringen_wsbe_wittel.csv * **-** Calw_wsbe_wimno.csv -> only 1 outlier * **-** Gomaringen_wsbe_mittel.csv * **-** Leonberg_wszu_rueb26.csv * **-** RÜB 4 Glashüttenweg wsbe_rueb4 2022.csv * **-** calculate different ''maxAllowedSlope'' for different time intervals in ''GetSlopeFromOneRowUDF'' * **-** try to make a "matrix" instead of "only minimums" * **-** try to configure Spark interpreter memory for Freudenstadt project * ''-Xmx16g'' worked, but: "Output is truncated to 64048000 bytes. Learn more about ZEPPELIN_INTERPRETER_OUTPUT_LIMIT" * => change ''zeppelin.interpreter.output.limit'' value in ''zeppelin-site.xml'' * **-** refactor ''GetSlopeFromOneRowUDF'' * **-** move ''maxAllowedSlope'' member to ''MarkSlopeFromOneRowUDF'' class * **-** make a Transformer for "Blockdistanz" (see "1.2 Blockdistanz / Einstau Sonde") * **-** implement ''HadSlopeMarkerTransformer'' * **-** check in current implementation * **-** implement ''MarkAsBetweenNegativeSlopeStartAndPositiveSlopeEndUDF'' * **-** test * **-** test with data of one year * **-** tests with real data * **-** clean up in ''HadSlopeMarkerTransformer'' and in all UDFs used there * **-** simplify getting/marking slopes using only * SLOPE_TO_PREVIOUS_COLUMN_NAME_DEFAULT * => ''getSlopeToPrevious'' using ''GetSlopeFromOneRowUDF()'' * SLOPE_TO_NEXT_COLUMN_NAME_DEFAULT * => ''getSlopeToNext'' using ''GetSlopeFromOneRowUDF()'' * **-** implement ''SlopeBasedBlankingDistanceDataTransformer'' * **-** implement ''ReplaceValuesWithinEntlastungEventUDF'' properly * **???** use gradient (as first solution) => ''GradientBasedBlankingDistanceDataTransformer'' * (=> it should be not necessary because it is already calculated in ''HadSlopeMarkerTransformer.BETWEEN_NEGATIVE_SLOPE_START_AND_POSITIVE_SLOPE_END_MARKER_COLUMN_NAME_DEFAULT'') * **???** check how gradient can be calculated * proposal 1: * if (start point is near of the maxValue) * if(t2-t1 < X min) * if(slope > 0 && slope > maxSlope) * => mark as "probableBlockingDistance" * proposal 2 (older?): * if (start point is near of the maxValue) * if(there was a slope with "speed" <= maxSpeed) * **-** define scenarios * Scenario 1. (simple) * runter und nach einer Weile wieder hoch * Beispiel: Bild 1, zweite Lücke * Scenario 2. * runter, dann hoch, aber nicht bis zum Anschlag, dann ein paar mal hoch und runter, aber jedes Mal nicht bis zum Anschlag und nur ziemlich später wieder hoch bis zum Anschlag * Beispiel: Bild 1, erste Lücke * Scenario 3 * runter, dann relativ stabil, dann aber noch stark nach unten * Besipel: Bild 3 * Scenario 4 * ask Benjamin * letztes Bild im Abschnitt 1.2, letzte Lücke * es ist unklar wie die rechte Seite von der Lücke korrigiert wurde * **-** test all defined scenarios * **-** optimize building * set jar to "target" of sparktest * **-** create a new project for transformers * **-** test "1.1. Einfache Ausreißer" * test data is in ''/home/vkalaschnikow/Desktop/buero/Entwicklung/Plausibilitätsprogramm/Beispiele Messfehler Datenlücken'' * **-** implement a graph for our data * **-** find out which graph libs exist * **-** decide how to handle "big data problem" * **-** find out which solutions exist * **-** implement 2-3 options * **-** "data gaps analysis" -> ''SparkTester.getStatsAboutMultipleIntervals()'' * **-** test [[Apache Zeppelin]] * **-** build zeppelin from IntelliJ * **-** Writing visualizations: * https://zeppelin.apache.org/docs/0.11.0/development/helium/writing_visualization_basic.html * **-** [[Apache Spark]] * **-** check statistics possibilities * **-** check reporting possibilities * **-** [[Lieb-ib]] * **-** [[Maven]] * **-** [[https://maven.apache.org/guides/introduction/introduction-to-the-lifecycle.html|Introduction to the Build Lifecycle]] * **-** Anleitung für neue Mitarbeiter * **-** [[Acron]] kennenlernen * **-** Acron-Anleitung.docx * **-** Beschreibung Datentransfer.docx * Projekte zur Einarbeitung * SES * Sindelfingen Q3 2023 * Aalen Q3 2023 * ... * ... * ... * **-** [[DWA-M 151]] * **-** Entry Part 5 into my wiki * **-** Summarize Part 6 ====== Task pool ====== * **-** [AA] Learning Angular * **-** [[Angular Docs Understanding Angular]] * **-** Components * **-** Component styles * **-** Sharing data between child and parent directives and components * **-** Tutorial: [[https://angular.io/tutorial/first-app#build-your-first-angular-app|Your first Angular app]] * **-** [[https://angular.io/guide/architecture#introduction-to-angular-concepts|Angular Concepts]] * **-** [AB] Decide what I want to do * **-** [[Search for business idea]] * **-** [[Checklist plugin]] * **-** check open source Task management systems * **-** OpenProject * **-** check open source CRMs * **-** check [[https://www.espocrm.com/|EspoCRM]] * **-** Check apps * **-** something for Fleetmanagement * misc links: * https://www.capterra.com.de/directory/20007/fleet-management/software * https://gomotive.com/ * https://fleetgo.de/ * https://track-platform.com/ * https://www.gps-server.net/gps-tracker * https://play.google.com/store/apps/details?id=org.mobilegpstracker.client * **-** Tracker for Traccar * **-** can it be profitable? * **-** what if the app would be contain an optional "Tasks" feature? * configuration * enable * server address * user * etc * simple user creation * **-** Professional GPS tracker * IoT parameters * **-** Open Source Geschäftsmodelle * https://www.elug.de/themenabende/oss-business/Seminararbeit.pdf * https://unternehmerkanal.de/ideen/55-erfolgreiche-geschaeftsmodelle/ * https://www.vawi.de/Open-Source-Software-in-Startup-Unternehmen_203.aspx * https://www.trendingtopics.eu/open-source-gastbeitrag/ * **-** make a plan for Avril * **-** development * **-** sales and marketing ====== Goals for the week ====== * [[Lieb-ib]] * ... * [[Avril]] * ... * [[Tracker For Traccar]] * ...