2022-04-10T14:29:00Z New editing day has started, hey its actually new YEAR!
Just woke up after spending two days just editing/playing arma3 MP on dedicated server (mostly playing), but when waking up today I just had that feeling for terrain editing, when opening 00.txt real world data terrain tool pipeline text file I was happily surprised to see poland krynki as next terrain on the list, I love editing this terrain, good european rolling hills woodland environment. So just finished reading this dev diary through, got up to date whats been done... and now its time for a days first meal.
2022-04-10T15:02:00Z Feeding time is over, now lets begin editing some big ass european rolling hills woodland terrain
First I deleted the _08 layers PAA and RVMAT files and addon directories. Then moved terrain builder objects layer files to the main source dir so they wont be loaded, imported heightmap_smoothed_roads.asc which I have to assume its the properly smoothed out roads, rebuilt terrain and removed the new ASC layer.
Then changed mapframe properties surface mask pixel resolution from 1024 to 2048, this will fix the too many layer RVMAT config files and also arma3 2D mapview zoomed out "mosaic" bug.
However now I need to global mapper export satellite mask grid tiles.
Maybe 15min wait or so, nothing too bad.
Then terrain builder imported roads.shp shape file as its now broken straight outta global mapper, arma3 cant read it properly.
And exported it right back out again, now its fixed, arma3 reads it just fine.
While global mapper was still exporting, I already started to setup web page php files for PMC Poland Krynki terrain, gotta optimize time use when there is nothing to do while waiting long processes to finish. Speaking of which, we got today plenty of those, terrain builder satellite mask import, generate layers, convert PNG to PAA and then finally binarizing, ugh. A lot of free time to edit web pages.
2022-04-10T15:31:00Z Template web page php files done and strings renamed properly. Also created release procedure list even though we are not even close to release yet, but just doing a little prep work on the side while waiting
Then used graphicsmagick and ran _run_graphicsmagick_convert_Sat_Mask_PNG_to_BMP_with_white_fix_4x4.bat to RGB color convert as well as PNG to BMP convert the Sat_Mask_??.png images.
Once graphicsmagick finished its voodoo, terrain builder started to import Sat_Mask_??.bmp images.
2022-04-10T15:46:00Z Satellite mask import finished, looking all colorful and peeerdy.
Then right away started terrain builder generate layers, this will take a few hours.
And now we wait. While waiting I can continue editing those web page files, getting them as ready as possible with the files I have in hand right now, meaning don't have screenshots yet.
Added pmc_poland_krynki class name to PMC "worldSize" mission pack compilation bat terrains list. This will generate bunch of missions for this terrain.
Updated mod.cpp with accurate google/maps and homepage links.
2022-04-10T21:04:00Z Ugh, while waiting for terrain builder to finish got tired, so quickly that had to go take a nap without even writing down a time, just got up now and obviously generate layers had finished.
Saved project and exited terrain builder, moved objects layer files back to the layers dir, loaded the project back up and exported WRP.
That is a whole lotta objects, unless I'm mistaken its the official world record right now, PMC Poland Suwalki has 18.1 million objects and this one has hundred thousand or so more. PMC Balkans ... dunno which, kosovo? cant remember, it had 20 million something in some experimental build but it was never released so it doesn't count.
Ran moveObject re-path WRP, then started convert layers PNG to PAA fast bat again. Soon we get to start binarizing this biatch.
Still waiting to get the first (is it first?) 2022 in-game arma3 look on the terrain, but I'm going to move this dev diary already to its final destination in the actual web page php file so I can start putting in links and proof read it slowly while binarize (soon) runs.
At this point made a mistake, once convert layers PNG to PAA fast bat had finished, I without thinking just ran pboProject bat file... even though I needed to separate WRP and Data addons and re-path RVMATs before that. Uh oh, idiot
Speaking of idiots, pboProject has now moved the terrain builder project Source/ dir into p:\temp\ and I don't want to mess around with that so I'm going to get that tool just run its course which is probably going to be 45min if it processes all the 18.2 million objects normally, it should abort quick though as the RVMATs are pointing to a empty dir, dunno. Oh well, gives me more time to work on this dev diary link adding and proof reading.
2022-04-10T21:52:00Z Was looking at pboProject and it was sloooooowly copying some shit around, yeah forget that man, I ain't doing slow shit like that, so I windows task manager killed the process. File explorer browsed into E:\PDrive\temp\pmc\pmc_poland_krynki\ dir where I found the source/ dir, moved it back to terrain builder project dir.
Ran the WRP and Data separation bat file and started moveObject re-pathing of layers RVMAT config files.
All done, started pboProject binarization, lets hope my little goof up did not break anything nor did I forget anything else
2022-04-10T22:50:00Z But uh oh, pboProject binarization failed because layers RVMATs were not properly re-pathed, oh man did I forget to run moveObject for WRP then, geez. Well been editing PMC Editing Wiki new namespaces and pages so more info can be found and these dev diary pages can have official PMC links instead of 3rd party ones, so yeah might have easily made that mistake when working without a tool pipeline.
So I ran moveObject for WRP, then double checked by running the "_log.txt" bat as well and it outputted:
//pmc_poland_krynki.wrp pmc\pmc_poland_kruszyniany\data\layers\p_000-043_l08.rvmat pmc\pmc_poland_kruszyniany\data\layers\p_000-044_l08.rvmat pmc\pmc_poland_kruszyniany\data\layers\p_000-045_l08.rvmat pmc\pmc_poland_kruszyniany\data\layers\p_000-046_l08.rvmat
Yikes, thats not terrain of ours!
Seems like terrain builder internal project is still pointing to that mumbo jumbo nobody can pronounce or write except honger polish name heh, alright so I need to fix that temporarily in my moveObject _MASTER_paths.txt file, simply by adding that mumbo jumbo class name there.
But after running moveObject I realized there was ending \ in the path name which fucked it all up. So had to load project up with terrain builder and export WRP again, sigh. Then once again, hopefully the last fucking time now, ran move-motherfucking-Object to re-path WRP...
It worked, finally.
2022-04-10T23:04:00Z Started pboProject binarization, AGAIN. Lets make it good this time, good i say, GOOOOOOD!
2022-04-10T23:47:00Z Timing couldn't been better, just finished initial GIMP, GraphicsMagick, PMC Heightmap Clipper, PMC OSM Places CSV2HPP converter, GEBCO, ArcGIS etc pages for PMC Editing Wiki and boom, binarize finished... with an ERROR. And now I'm starvin' gotta get some chow...
2022-04-11T00:16:00Z Feeding time is over, now lets continue fixing that broken ass terrain hehe!
Was looking at binarize log which says pmc_poland_krynki\data\layers but where the fuck does it read \ instead of _ as its set in RVMATs and WRP. I do NOT get it!
Ran the WRP moveObject log creating feature once more, just to double check (even though I already checked it). Output _log.txt file shows:
//pmc_poland_krynki.wrp pmc\pmc_poland_krynki_data_layers\p_000-043_l08.rvmat pmc\pmc_poland_krynki_data_layers\p_000-044_l08.rvmat
So again I'm asking there the fuck does this bitch find the wrong path, aarrgh!.
Went and deleted P:\TEMP\ completely, erased everything to oblivion, poof! Lets binarize AGAIN to see if that helps, as I'm running out of ideas here.
2022-04-11T01:11:00Z Negative, we have NO go
Seriously what the hell is going on now?
Checked out pboProject log in p:\temp\ and it shows:
pmc_poland_krynki.wrp:validating... checking for missing files... pmc_poland_krynki.wrp: missing \pmc\pmc_poland_krynki_data_layers\p_000-043_l08.rvmat ... pmc_poland_krynki.wrp : \pmc\pmc_poland_krynki_data_layers\p_085-085_l08.rvmat missing file(s) pmc_poland_krynki.pbo not produced due to error(s)
Say what now again? How are there layers up to 085 file name range as I just generated layers to 043 range, ugh...
Went to terrain builder mapframe properties and it says clearly tiles in row: 43
So why the hell does pboProject/makePbo complain about missing RVMATs that are not even used in this terrain. _WHY_
0:29:13: Cannot load material file pmc\pmc_poland_krynki_data_layers\p_000-043_l08.rvmat ... 0:29:15: Cannot load material file pmc\pmc_poland_krynki_data_layers\p_085-085_l08.rvmat
It feels like there is some old WRP file laying around now which gives false readings. Checked _run_pboproject_pmc_poland_krynki.bat which I use to binarize and it reads pmc_poland_krynki_addons.txt file which clearly states:
pmc_poland_krynki_data_layers_04 pmc_poland_krynki_data_layers_03 pmc_poland_krynki_data_layers_02 pmc_poland_krynki_data_layers_01 pmc_poland_krynki_data_layers_00 pmc_poland_krynki_data_layers pmc_poland_krynki_data pmc_poland_krynki_cfg pmc_poland_krynki
So all addon processing files are working properly. Hmph.
2022-04-11T01:33:00Z Terrain builder exported WRP for what, third time now? Ran moveObject log into the WRP, it shows _42 range RVMATs just OK, ran moveObject re-path WRP, all looks still good as the path changed. Then started pboProject binarization. I don't know what would have changed, but this now triple checking that everything is OK, if it fails now... then I just simply need to get medieval with this bitch.
2022-04-11T02:18:00Z Still the same error, missing RVMATs up to 085 range... I simply do not get it. Okay I promised medieval shit, so gets crank up the heat...
Deleted p:\temp\ dir, then moved terrain builder object layer files away from the dir, loaded project in terrain builder and exported WRP, my theory was that the 18.2 million objects somehow broke the terrain builder project and it exports "bad shit" to WRP.
Well inspected WRP and, just by coincidece saw that there are lower case file name like this:
//pmc_poland_krynki.wrp pmc\pmc_poland_krynki_data_layers\p_000-043_l08.rvmat ... pmc\pmc_poland_krynki_data_layers\p_085-085_l08.rvmat
Now that is alredy the culprit right there, "but! There is more!" hehe. The _log.txt output from moveObject -L continues to show file names in this case:
pmc\pmc_poland_krynki_data_layers\P_000-000_L01_L08_N.rvmat ... pmc\pmc_poland_krynki_data_layers\P_042-042_N_L20.rvmat
Err, say what... there are TWO (2) lists of layer RVMAT's now in my WRP file. How in the world I managed to create such WRP?
First the wrong 000 to 085 which is too much, the old set and then from 00 to 042 which is the correct set from last generate layers.
I have never ever seen such mangled up WRP before
This happened because I renamed terrain builder project, instead of deleting everything and re-creating it from scratch. Go figure, the more I use these tools the more odd stuff I see over the years
Well at least on the bright side I figured out what the issue was and learned a valuable lesson: you cannot rename terrain builder project.
I'm going to document this, to share with the community and then... well shiet dude, I have to export global mapper satellite texture first, then put in the clouds fixed grid tiles, graphicsmagick convert it and only then I get to re-create the whole terrain builder project by importing all that shit. Aww maan!
2022-04-11T02:35:00Z Global mapper satellite texture export started, sigh.
2022-04-11T03:51:00Z Was moving my local notes pages to PMC Editing Wiki with such a passion that forgot to check and global mapper probably finished close to half an hour ago already, time flies when you're editing wiki pages hehe.
2022-04-11T03:57:00Z Created brand new pmc_poland_krynki terrain builder project
Imported heightmap and then started to import satellite mask BMPs while I went to prepare the satellite texture grid tile images in global mapper dir, those need to be opened in GIMP as XCFs and then saved out to PNG, so I can get my 2021 done edits in. These are the clone stamp tool brush off the cloud puffs edits.
Satellite mask finished importing, saved terrain builder project, I mean why not. Continued opening and exporting GIMP XCF satellite texture tile images.
Was chuckling that I had myself convinced that krynki gets released today, hah, don't get your hopes up and make plans too far ahead, you never know what will fuck up and eat half a day of work to fix
2022-04-11T04:29:00Z Terrain builder started to import satellite texture tiles. Slowly making progress.
Once it finished then started generate layers right away, this again takes couple of hours so dunno, hopefully get to see end result before going to bed tonight.
2022-04-11T04:47:00Z Generate layers started, here we go, again
Now, hmm I'm going to do some chores on the background, grab a bite to eat while this whole process gets to the point that we are ready to binarize.
2022-04-11T05:13:00Z Started proof reading and adding links to this dev diary.
2022-04-11T06:22:00Z Finished proof reading and link adding this dev diary, now all it needs is screenshots. But now, is my last meal for today, again starving...
2022-04-11T06:53:00Z Feeding time over. Terrain builder finished its thing too. Restored objects layer files in the dir, loaded project up and exported WRP.
Lets convert some layer PNGs...
2022-04-11T07:25:00Z Started pboProject binarization, once again, hopefully the last time before release.
Binarize was still chewing on the WRP addon, I started to get tired.. correction, eyes started to get sore/tired, didn't feel tired yet, however decided to start watching TV while waiting for this process to end. Binarize finished successfully. However after finishing TV watching it was already so late in the night for me that decided to leave arma3 in-game check for tomorrow.