Latest News: Difference between revisions
No edit summary |
No edit summary |
||
(4 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
'''November 12 2024 | |||
* Still plugging away at People, but made some big strides. With a stable VBA routine for matching names I worked through the 1897 D3 in about 5 days. I then decided that the lessons learned up to now could lead to a much better system for the years from here on, so have started developing the a still better version of the name matching code. This latest version is based on the logic that people do not change jobs randomly, so with the D3 list in a stable order, and every position is formally identified, the new system enables the editing of the previous year's data so it matches the next year's list. Data Rows can be moved out to a holding file of Spare Names, copied back in to a new position,and new entries add. The coding of that has proven a bit challenging but the user interface is now well defined and the desired functionality worked out. Making steady progress on developing the chunks of code to perform each operation that is needed. The last couple of weeks have seen some distraction with an opportunity to advance the Glockenspiel project. I have hugely simplified the electronic interface and now opted to have the valve units 3D printed. Working through the testing of the first sample print which showed a few issues. Cannot do a lot more there until the last parts arrive from China. So it is back coding VBA. | |||
'''October 16 2024 | |||
* Just a quick note to say that the vision graphic on the Main page has been updated to reflect some of the recent work and two additional topics were squeezed in, Clothing and Bookstalls, neither being high interest areas, but both fulfilled an important aspect of the railway environment. | |||
'''October 14 2024 | |||
* Some steady progress on People. With continued refinement of the VBA code for matching up people, I have now worked through all of the 1896 D3 with greater confidence in the end result. I had found that rushing into the 1896 data was a mistake though, as I have found about 30 duplicates that careful checking should have found. I will review those and decide if I leave the 30 'spare numbers' or look at eliminating them somehow. The next step is 1897 using the same code, before adopting a more automated system given each employee will have their full classification data available when comparing 1897 and 1898. I have also decided that the Master List needs to be part of the main staff file so when required, a copy will be made for each year's checking and saved as a back-up. In between I also continued with sorting out the S$I diagram maps. Having decided to focus on the MNL to start with, I found it was so intertwined with the start of the MSL that I sorted out Lyttelton to Chertsey first. That was quite a mission but also enabled the format to be well established, leaving only the representation of the signalling type to be resolved. It would also be good to get the end result checked by a signals expert at some stage. | |||
'''October 6 2024 | '''October 6 2024 | ||
* Another quick update to say I have started an introductory page on NZR Signals. This was a follow-on to a bit of time I spent organising the collection of old Signals & Interlocking circulars for the South Island, using a format not dissimilar to the Network diagrams. I have copied the station names from the network diagram worksheet and compacted them a bit. I plan to eventually have those available in the wiki as tables but only accessible by line, not as a whole island network. These diagrams will show in sequence the S&I's that were issued for each station or section. The collection of old circulars I have access to is only up to 2014, with many of the early ones missing. Now that I have created a first attempt at a diagram, I will develop that further by indicating known gaps and the status of stations at the time of each diagram. The Signals page will eventually have links to the tables for each line, other pages that can describe specific signalling systems in more detail and hopefully have links to the old circulars. On the People side of things I have started name matching of the 1896 D3 but came to realise there were too many situations where you needed a much better understanding of starting dates when trying to match some names. I therefore worked on trying to calculate a realistic start date for as many people as I could, and then also wrote a quick VBA routine to convert start dates to years of service. I probably achieved over 90% of names having a start date so will flag any where I feel some fine tuning wouldn't go amiss. | * Another quick update to say I have started an introductory page on NZR Signals. This was a follow-on to a bit of time I spent organising the collection of old Signals & Interlocking circulars for the South Island, using a format not dissimilar to the Network diagrams. I have copied the station names from the network diagram worksheet and compacted them a bit. I plan to eventually have those available in the wiki as tables but only accessible by line, not as a whole island network. These diagrams will show in sequence the S&I's that were issued for each station or section. The collection of old circulars I have access to is only up to 2014, with many of the early ones missing. Now that I have created a first attempt at a diagram, I will develop that further by indicating known gaps and the status of stations at the time of each diagram. The Signals page will eventually have links to the tables for each line, other pages that can describe specific signalling systems in more detail and hopefully have links to the old circulars. On the People side of things I have started name matching of the 1896 D3 but came to realise there were too many situations where you needed a much better understanding of starting dates when trying to match some names. I therefore worked on trying to calculate a realistic start date for as many people as I could, and then also wrote a quick VBA routine to convert start dates to years of service. I probably achieved over 90% of names having a start date so will flag any where I feel some fine tuning wouldn't go amiss. |
Latest revision as of 09:30, 12 November 2024
November 12 2024
- Still plugging away at People, but made some big strides. With a stable VBA routine for matching names I worked through the 1897 D3 in about 5 days. I then decided that the lessons learned up to now could lead to a much better system for the years from here on, so have started developing the a still better version of the name matching code. This latest version is based on the logic that people do not change jobs randomly, so with the D3 list in a stable order, and every position is formally identified, the new system enables the editing of the previous year's data so it matches the next year's list. Data Rows can be moved out to a holding file of Spare Names, copied back in to a new position,and new entries add. The coding of that has proven a bit challenging but the user interface is now well defined and the desired functionality worked out. Making steady progress on developing the chunks of code to perform each operation that is needed. The last couple of weeks have seen some distraction with an opportunity to advance the Glockenspiel project. I have hugely simplified the electronic interface and now opted to have the valve units 3D printed. Working through the testing of the first sample print which showed a few issues. Cannot do a lot more there until the last parts arrive from China. So it is back coding VBA.
October 16 2024
- Just a quick note to say that the vision graphic on the Main page has been updated to reflect some of the recent work and two additional topics were squeezed in, Clothing and Bookstalls, neither being high interest areas, but both fulfilled an important aspect of the railway environment.
October 14 2024
- Some steady progress on People. With continued refinement of the VBA code for matching up people, I have now worked through all of the 1896 D3 with greater confidence in the end result. I had found that rushing into the 1896 data was a mistake though, as I have found about 30 duplicates that careful checking should have found. I will review those and decide if I leave the 30 'spare numbers' or look at eliminating them somehow. The next step is 1897 using the same code, before adopting a more automated system given each employee will have their full classification data available when comparing 1897 and 1898. I have also decided that the Master List needs to be part of the main staff file so when required, a copy will be made for each year's checking and saved as a back-up. In between I also continued with sorting out the S$I diagram maps. Having decided to focus on the MNL to start with, I found it was so intertwined with the start of the MSL that I sorted out Lyttelton to Chertsey first. That was quite a mission but also enabled the format to be well established, leaving only the representation of the signalling type to be resolved. It would also be good to get the end result checked by a signals expert at some stage.
October 6 2024
- Another quick update to say I have started an introductory page on NZR Signals. This was a follow-on to a bit of time I spent organising the collection of old Signals & Interlocking circulars for the South Island, using a format not dissimilar to the Network diagrams. I have copied the station names from the network diagram worksheet and compacted them a bit. I plan to eventually have those available in the wiki as tables but only accessible by line, not as a whole island network. These diagrams will show in sequence the S&I's that were issued for each station or section. The collection of old circulars I have access to is only up to 2014, with many of the early ones missing. Now that I have created a first attempt at a diagram, I will develop that further by indicating known gaps and the status of stations at the time of each diagram. The Signals page will eventually have links to the tables for each line, other pages that can describe specific signalling systems in more detail and hopefully have links to the old circulars. On the People side of things I have started name matching of the 1896 D3 but came to realise there were too many situations where you needed a much better understanding of starting dates when trying to match some names. I therefore worked on trying to calculate a realistic start date for as many people as I could, and then also wrote a quick VBA routine to convert start dates to years of service. I probably achieved over 90% of names having a start date so will flag any where I feel some fine tuning wouldn't go amiss.
September 26 2024
- Just a quick update on a small addition to the wiki. We can now upload and organise heritage photos into a Cargo Table. This was a very quick exercise all coming together within 24 hours. There are two quick-link buttons available to admin users to generate the pagenames either before or after the files have been uploaded. The only constraint is that things need to be done in sequence, either upload the file and then add the template to the files page, or create the file page with a template and then link the file to it by uploading it. The pagename format is File:PhotoNNNNNNN.png. Filenames could be manually generated but you then have to manually add the Cargo Template. Mediawiki's own file management system stores things like dates of upload, resolution etc so the Cargo template only holds image information, Where, When, What by Whom etc. With regard to the People side of things, the upload to the wiki seems to all work again, just not confident that all the data is in as expected given I was updating pages rather than creating new ones.
September 23 2024
- I made good progress with coding the new version of the Name-matching routine, making several improvements as debugging progressed. The only section not coded yet relates to name-lists of more than ten. These were going to be handled using scroll bars for each data grid but I could see they would involve some complex coding. Instead I programmed a suspend option button which allowed some simple work-arounds to be used in the meantime. That allowed me to quickly get through the whole 1895 file, with much greater confidence in the final result. I will now focus on updating Cargo to match the new Date format (simplifying the table structure) and see about getting the first 5000 plus records into the wiki again.
September 15 2024
- I still have some issues with Excel performance to the extent that it slows down to unusable on one worksheet. That signifies it is time to shut down, but the fact that that is every couple of days has me thinking the computer might have memory issues (I know I have). Not being satisfied with the accuracy of name matching using the VBA routine I wrote, I decided on a different logic for the code and have now written the bulk of it and now in the detailed testing and debugging phase. The logic now is to work through the Year list (in this case 1895) in parallel with the Master list, which means names are really only processed once, rather that each Year name being separately searched for in the Master List. Matches are still required to be confirmed by the user. Matches of single individuals are on a separate screen from multiple persons with the same surname, which have all names presented all at once, eliminating the chance of allocating a Master name to two people. I am of course able to apply a lot of what I developed for the first version in this new and improved version. Getting to this point has taken a lot longer than hoped but by the end of the week I now hope to have a definitive allocation of earlier ID numbers and an accurate list of 'new' staff for 1895. As a bit of a side-line, I have been scanning through the New Zealand Cyclopedia volumes (six in number and totaling nearly 6200 pages) and marking with post-it notes all references to railway people and places, as well as specific tramway references. Some of these help complete Master list data with christian names and dates (whole or partial) of birth, work, marriage or death. A separate second pass later will try and identify all sawmill data which will help in identifying tramways.
August 12 2024
- The past week or two has been one of many frustrations. On numerous occasions Excel has stopped working or behaved bizarrely, once even reverting to a copy of the data from one week earlier while I was editing the file!! It got to the point that I was loosing so much data in little chunks that I had to resort to reinstalling Office 365 yesterday. I have not had any recurrences yet. Due to a separate issue a long time ago, I had lost the 1896 D3 data tab, and with cloud back-ups only going back a wee way, I was left with no option but to rebuild that tab, over a week's work. As I move forward again I find bits of data messed up all along the way so keep having to spend time cross-checking things. One of the next steps is to deal with another chunk of historical data that is found in the right margin of the 1895 and 1896 D3's. This lists with minimal detail, earlier service for those who have been reemployed. Given I have to recheck some 1895 data before allocating person ID's to 1896 data, I think I will slot this additional block in between the 1894 D16 and the 1895 D3 and call it 1896PS (for Prior Service). For the portion of the 1896 file I have processed, there appear to be very few entries in the 1895 list that are not in the 1896 list, with the 1897 list not recording this information at all. Having it helps complete the service records of about 500 people and gains insights to some of the employment practices during depression years.
August 2 2024
- Work on the wiki this past month has been dictated by unexpected external events. My IT support team which hosts the wiki, completed a server upgrade which has made a big difference to the speed of the wiki. There was obviously some aspect of the way it was configured that caused some of the persistent delays I was experiencing. It has not dealt with some of the very annoying longer delays, but a good improvement over all. That set my clock back to last February when I abandoned work on People because I could not load the data in via spreadsheets. I did some quick testing and things seem to work again. Since then I have been reviewing all the people data, rebuilt the MasterList, ans now sorting some peripheral issues. The biggest of those is Dates. Because MS Excel cannot process dates before 1900, it converts those to text strings, but things get very messy with formats when you try to export data from Excel. To overcome this, I have elected to deal with all dates as text. Should we need to do calculations that use dates, a process will need to be worked out then to convert the text to a number, but that is a problem for later.I am currently verifying the data for the first full staff list (known to include many omissions and errors) which will form the base for processing data for subsequent years. I completed writing and testing a fairly complex VBA routine to simplify matching up MasterList names with names in a new year list, which helps hugely, but will need modifying as we move towards more stable data in the years from 1897 onwards. These later lists follow a consistent order where logical assumptions can be made when a name does not appear in the sequence it was the previous year. Utilising that will allow a far more intelligent bit of code to be developed greatly speeding up the processing of names.
June 22 2024
- As has happened a number of times already, I have got distracted and spent some time looking at other data again. As concepts firm up in one area it is good to look at some of the challenges in another area as eventually everything needs to work together. This time Tunnels, Incidents and locomotive life history. Most of the loco data is pretty straightforward as Tom McGavin has done so much work over the years documenting railway loco data. A series of booklets was published from 1959 - 1990 about 5 yearly, listing the places each locomotive was allocated to. My thinking was if this data is all tabulated and loaded into Cargo Tables, some cleaver querying could produce some interesting table data, e.g. Which places was a loco based at throughout its life? What locos were allocated to a particular yard or Depot over the years? What was the average working life of a particular loco class? What incidents were loco's involved in? etc. While devising the queries for some of these is beyond me at the moment, as we start developing pages for individual Locos, Yards or Depots, these are things that can be added to the pages. However, before you can write a query, you must have the data in a table, so that is what the current exercise is all about. I have focused on diesel shunt loco's in order to keep the amount of data I am playing with at present manageable.
June 8 2024
- It feels like a lot more than a month has passed since my last notes, possibly because I have had to divert my energies elsewhere again. A fair chunk of time was spent on CAD work for the Waimea Plains Railway, and I also focused on making headway in creating a facsimile copy of a more than 100 year old book I only had a bad photocopy of. That may be able to become a small fundraiser in the future. With regard to books, most effort has been focused on sorting and adding to my library, I probably have a few hundred titles that have some recorded railway or tramway history, but are not ordinarily identified as a rail heritage book. Some might have a chapter or two, others only a page or two, but they all add to making up the big picture. While I have created Book-copy data ready for loading, I still need to create the entries for the Book table, and will get on with that before that gets too far behind everything else.
May 5 2024
- We keep finding things to trip us up, all part of the big learning experience. Having recently redone Book pagenames, I found I had to redo all 450 again. Pagenames should not use any special characters, especially colons, as they can cause problems with queries. Working under some pressure I have now nearly finished all the book pages for the 3rd time. I used this exercise to catch all the Book-template error at the same time. Finally, I now have queries working and things appearing tidily on the page. At some stage I will still look at the formatting of the whole page for improved use of space on a desktop machine. I will now press on and get the next 200 books entered to at least have the bulk of my books recorded. I have also approached two others who are happy to have their books listed. I expect nearly all their books will already have book-pages so it really just means sorting out the book-copy data.With those entered the Library functionality will start to become useful. I will probably box off Magazines next while making good progress in this area.
April 29 2024
- Some steady progress has been made but not all in the areas that really needed working on at present. I continued with Industrial Tramways to the extent that I defined the whole North Island and its nine Regions, then focused on Northland, thinking that wouldn't have all that many tramways, but ended up defining some 20 tramway areas. I then started analysing the individual tramways that were recorded in a couple of those before realising I could get lost in that side of things and needed to get back to Books. I therefore double checked a lot of details with regard to the various tables that make up the Library functionality. I found that the process of updating the templates on the Book pages was not really robust enough and I now have a lot of manual edits to do. The tricky bit is finding the offending templates so I can edit them. There were also many changes and bits of fine tuning required to the Templates, Tables and Forms before I was actually ready to start experimenting with Cargo Queries. But I got there, and after significant detailed research I was game to try my first query, it didn't work. A quick question to the Cargo developer and I found I had missed a capital letter in the middle of a Cargo variable name, I should have spotted that. However, it still didn't work, so another question for the developer. I want to get to the point that this stage of the Library is functional before I try importing data about People again. Hopefully the issues I struck last time have resolved themselves.
April 19 2024
- I now have a tidied up personal library of over 600 'railway' books and a dataset of 28 different books to load spanning eight separate libraries for testing. Some books are in all eight libraries, others in only one or two. This will allow testing of the first queries. I have also started thinking about some other larger and more complex areas of the wiki, one of which is Industrial Tramways. This will be divided into four groups, Bush Tramways, Mine Tramways, Construction Tramways and Factory Tramways. Each will be further divided based on region/locality/Owner/track. in other words, if you don't know how to search for a tramway, you can do that via a map, first by going to the Region the tramway is in, then defining a smaller locality, at which point you will have both a list of recorded tramways and a more detailed map of an area. That will show individual tracks that make up the tramway network of various owners. To start achieving that I have prepared a New Zealand map divided into regions, and will use the Imagemap extension to create clickable zones for selecting a region of the map. That is all straightforward now as the same system is used on the main page to select a topic.
April 10 2024
- Health issues and other commitments have slowed things down a bit. Still working on Books and observed the need to tidy up my own library data before locking certain info into the wiki. I came across lots of surprises, both good and awkward. I have now got that pretty well sorted and written a VBA routine to generate Book-copy records so the next step is testing that in the wiki. All being well, I then mock up some matching books for a second and third library so I can begin the task of generating queries, of which the first will be Libraries holding the current book. There is still a bit of data checking to do on the Book records that I will need to work through.
March 17 2024
- Work on the Library functionality continues, some 500 book titles have now been entered but 200 of those are still in the old table, progressively being transferred. Looking ahead I realised it was best to do the magazines as well as we may strike the same problems later. That totals 380 records at the moment. I have also looked in much greater detail at Published References, and come to the conclusion that the Tab I had created for this right at the beginning, would be better called 'Facts'. This came about by understanding that data that goes on a tab is data in another Namespace, a detail I had not known about until recently. However, thinking about the implications, it is really just what is needed, but when you work with different namespaces (think different groupings of data) you need to define the namespace in front of the pagename, other that for those pages in the mainspace. It is useful then to use short names and a 5 letter name is then preferable to a 20 letter one. I have also updated the 'Main page' with the mind-map now having an additional two groups and several more balloons are now shaded, signifying progress. I have also grouped the Mechanical Branch and its sub-groups in one area, the start of improving the grouping of all the balloons.
March 1 2024
- With most of the Library entered, I started thinking about using the data. I created the three additional tables and then started nutting out my first query. Simple queries seem to be quite straightforward, but when I wanted to test my first one found I didn't really have the database set up quite right. There were two main problems, the database name was confusing in that I had called it "Books" when it should have been "Book"; and the the page names for Books were also confusing in that there was no indication in the page name that it was a book page rather than a subject page. For this reason I needed to rebuild the database table. At the same time I decided that it would be best if I also adjusted a few of the Fields that didn't quite meet requirements anymore. To avoid having to manually re-enter all the book data (450 records so far) I developed a method of copying the old Template data, pasting it into the new page then adjusting the Template name. Being able to do over 50 a day in between other this meant it was not going to be such a huge task.
February 24 2024
- With no clear answers to why I am unable to reliably load data into Cargo from Spreadsheets, I have decided to set that aside for a little while. As a distraction I have decided to enter my Rail Heritage Library into the Books table, one record at a time through the Books Form. Nearly there after 3 weeks and 450 books, with maybe 50 - 100 books to go. This also had me thinking of the next stage of the books functionality so I created 3 additional Tables, Book_Copy, Magazine_Copy and Library. This will allow the holding of data on individual copies of books and magazines and record which Library they are held in. That in turn has had me looking at Cargo Querying in some detail, another whole language to learn. The first query I want to master is reporting on a Book page, which Libraries hold a copy of that book.
February 9 2024
- Hit a snag wile loading Work and Income History records with the Wiki extension not handling data imports properly anymore. I have developed a work-around for these type of imports but People data does not import completely either and there is no simple work-around for that. Trying to resolve things with the developer. A further issue is the amount of History data I have already accumulated. It exceeds the amount you can hold on a page and make editing the pages nearly impossible. It appears this type of data can be split over pages, but that makes querying more challenging, but not impossible. more learning to do there. A further problem I detected related to Dates. They were not transferring from the wiki page to the Cargo table reliable (many missing). This in turn resulted in duplicate records which Cargo discarded compounding the problem. A fix seems to be to enter all dates with a "-" separator rather than "/".
January 30 2024
- With a concentrated effort on processing people records, I am now ready to load 5000+ records to the wiki, for the third time! Have done lots of cross-checking and now have person data from all official reports from 1895 and earlier. The focus now will be to get the Excel data loaded and then derive Work History and Income History records from the source tables. From there on, the work will become repetitive, working through each new year's data, adding new records to the Master List, and updating the history records. On the Wiki side of things, the next major step will be creating the work and income history tables, then setting up the templates to query those tables so that data appears as tidy tables on the person records.
January 16 2024
- So into another new year and still working with people data as I felt I did not have a robust enough method of identifying individuals. While I have made considerable progress, it has not resulted in much additional data yet and all existing people records will be overwritten by a new set shortly. A significant concern that was bugging me for a long time has now been resolved relating to Cargo table data and wiki pages. The limited documentation with Cargo implied that you must have a wiki page for each Cargo record, however, Yaron Koren the author of Cargo has confirmed that that is not the case as you can hold many records on a single page by selecting Append on the Import Spreadsheet utility. A simple use-case for this is the work history of NZR employees. While you want a page for each employee record, you do not want a page for each work history record, all the records go on a single page with many rows of data that create the Cargo table records. Progress with re-sorting Names has been slower than hoped, mainly due to other commitments, but I am now nearly through all the pre-1895 data with some 2000 names properly back referenced now, and all with compatible source tables. From these I will now be able to create the Work History records and get them displaying properly on the wiki pages for individual people.
November 24 2023
- It has been a while since my last update but not a whole lot has changed. However, they are about to. I have had to have some time off for more spinal surgery but with that largely behind me now, there was a real need to push on with People data. I have today loaded the first block of People pages, nearly 5000. These are people that I have found in official list from 1895 and earlier, and I will now progressively add all the others I have sorted out up to 1900. I also need to build the other Templates to be able to load the data associated with the People, especially work history. Again a plea for anyone who has experience with setting up data in Mediawiki, I would love to hear from you.
July 5 2023
- All of June was spent on preparing data for the People side of the wiki, thousands of them! However, none of them have been added to the wiki yet for a couple of reasons, 1, I am not sure I completely understand the Table structures I need yet, and 2, I was still waiting for the spreadsheet extension to be added to the wiki, there were a few issues and with some other small issues popping up, we decided it was time to update a number of extensions, as well as Mediawiki it self. This site is now running on Mediawiki 1.39 and the latest version of Cargo and its counterparts. Page Schemas in particular has improved greatly making it much easier to modify a schema by being able to insert additional fields and move fields around within a table. I will need a couple of weeks more time on preparing the early staff lists before writing some code to interrogate them to produce useful data that can be stored in the wiki.
May 8 2023
- With the Previous and Next Issue buttons working well, it was still a lot of work to implement that on all Magazine issue pages, the better option was to include the code in the Mag_Issue Template, but you could then not manually tailor the line of code to suit the current Issue. It therefore required some additional code that could interrogate the existing Pagename, separate the Magazine and Issue number and create new variables of 1 less and one greater that the issue number to insert into the Clickable button2 code. Eventually found appropriate templates and functions and when Extension:Parser Functions was added to the wiki, one additional line of code in the Mag_Issue Template added both buttons directly under the Pagename. Using the pagename as the source, it automatically works for each different magazine. Have also completed the manual checking of the 1910 D3 list so now need to explore how/what to add to Cargo tables. Have also nearly finished entering key data from Volume 4 of the Observers. Will keep plugging away at these to try and get the first 14 volumes done.
April 30 2023
- Have had further success and setbacks with Able2Extract, and now waiting for a reply from the developers again. There is something in the pdf files that cause the program to hang, otherwise it does seem to fit the bill. In the meantime still working through the tedious task of checking names from the 1910 dataset which is a 2 person job and only getting 500 - 1000 names a day done. Have now passed 6100 out of 9050 so getting there. Have also started working with Magazine_Issues again, creating detailed contents for the Observer and have processed 3 volumes (18 issues) this past week. Decided the template needed some tweeking in that it needed to display the full name not the short name, and added a field for Page Range. That meant deleting the cover image field, and adding the Page Rage field and a new Cover Image field. Now all existing records in the Mag_Issue table need updating. While doing that, realised it would be useful to have some standard ways of referring to things, especially loco's, wagons, cars etc. This will then allow some quick searches if you know certain data is held in the wiki. Have also decided that from the Magazine Issue pages it would be very convenient to be able to move to the previous and next issues easier than typing the issue name in the search box. I have therefore exported the 'Clickable button 2' template from the Wikipedia site, and imported it to RKB. This allows buttons to be placed on a page with an associated hyperlink and independent button text. Two buttons side by side at the very top of the page, labeled 'Prev Issue' and 'Next Issue' work very well and now need to be added and edited for each Magazine Issue page.
April 24 2023
- Spent a lot more time than I should have on the 1910 staff list, but have now got all the data neatly in excel and just doing a final check of the names before I work out how to store it in Cargo. Have determined that the program Able2Extract is the right one for the task but found a bug in it which needs resolving before purchase it. As a change, I have started getting the Observer magazine data into the wiki. Have completed the Issue table (with all hyperlinks) for the whole series and an introductory page for the magazine as a whole, then using the Mag_Issue template to create each page. Now starting the laborious job of entering the data to describe each issue's contents in reasonable detail.
March 29 2023
- With some forced light duties for a while following back surgery, I continue to explore some new areas for wiki data. The first is Staff Housing; with a lot of information around about staff housing, but nowhere to usefully bring it all together, the Knowledge Base seems the ideal solution. With some data on about 1500 mainly South Island houses now in my list, the challenge will be setting things up and then sensibly integrating that with other data that is available. Secondly, I have decided to tackle the big area of employees. For years I have been aware of the Staff D3's and even attempted an OCR scan of some pages some years ago. None of that was leading anywhere promising, but with the early D3's now on the web as part of the Parliamentary Reports, I thought I would give things another go. With a bit of work (4 days), I have a 1910 staff list of some 9000 NZR employees, with their positions and rate of pay. Some of the data did not convert well so I am still exploring all the years of service info as I will need that to create unique records for individuals. With that as a starting list, I need to work out processes for adding new names before and after 1910. The lists with names only start at 1896 and go as far as 1923 on the web. They were produced up until 1986 I believe. Over the coming weeks I will continue to explore options in this area and start developing the Cargo tables required to hold this data. Employees in particular should attract a lot of wiki use with increasing interest in family research.
March 8 2023
- Continued to work on Locomotives with some additional general data pages created for locomotive types etc. Have also started a section on Rollingstock (of which locomotives are technically one branch) with a couple of general data pages there as well. I hope to tidy up that section over the next couple of weeks when I will have to take a forced break to recover from spinal surgery.
February 16 2023
- So the weeks continue to slip by, with the past ones focused on researching 'F' class locomotives. This has resulted in a pretty extensive page for this early locomotive type, setting out a preliminary page layout for this type of page and creating several tables of useful data. that has automatically listed every F class locomotive, so I have added links to those so pages so each loco can have its own page created if wanted. I have taken that step with a few specific loco's where I came across a reasonable amount of data I could put in chronological order.
January 24 2023
- The past month or so has seen some definite progress again, but off on some tangents. Images continued to be an area I wanted to box off a bit, so developed a method to store image data in a Cargo table. When I say images, it is actually an occurrence of an image, not a record of a unique image. This came down to defining a number of fields for image attributes like where is it located, what is its size, who is its creator, owner etc, date if available, and what size it is. Then there are two searchable text fields, one where you describe the over-all image (main theme of the image), and the other where you can enter other things that are visible, usually in the background, eg a signal, or wagon or locomotive. I then proceeded and entered about 350 images, working from the start of Rails magazine, and I have over 2 years done. As a result of that , I recognised that most of the images are naturally of locomotives, so I started thinking of how locomotive data might be constructed in the wiki. That led to starting an NZR Locomotives page, where the introduction is a overview of published New Zealand locomotive research. This is followed by a series of tables listing the data for all the locomotive classes used on NZ Railways. I have nearly completed the Steam Locomotive table and then have Diesel, Electric, Railcar, DMU and EMU tabled to do. They are all much smaller of course. Each table entry has hyperlinks to individual pages for each class (of course none of those are created yet) and also links to pages for Manufacturers. A similar arrangement could be adopted for Rollingstock later.
December 14 2022
- As the year comes to a close you wonder where the time has gone, certainly not a lot of time spent on the wiki. Having completed the Railfan magazines, I started on the Rails magazines and got the first 50 issues entered. These are a monthly issue so many more to a year, however they are thinner so less entries. Towards the end of October I had to set aside all wiki work to focus on a major home renovation task of rebuilding a bay window. Being a double storied vintage home, everything had to be measured and drawn accurately in CAD before physical work could commence, and I am now well into dealing with the lower story which has resulted in solving most of the issues I am likely to strike. I don't expect to complete things till we get well into autumn. So with the problems solved, it does free-up some time for wiki things again. While I will try and keep working away at the magazines, There is still some South Island Station details to complete before trying to get the North Island Station pages created.
September 20 2022
- A couple of weeks ago, I took the opportunity to borrow a full set of Railfan Magazines. This allowed me to scan all the covers and create a wiki page for each copy. Some standard data about the individual issue is stored in the Cargo database and retrieved for display at the top of each Magazine Issue page. In the free text area of the page, I have entered a slightly expanded Table of Contents, listing all the main articles, each book, and video that is reviewed, each heritage group that has a news item and each general rail news topic that is covered. All this data immediately becomes searchable, so it becomes a quick way to determine in which issue of Railfan you can find a particular topic. I have a few days work left before I have entered all 101 issues. I intend to do the same for Rails magazine next (but at a slower pace), as I have my own copy of each issue, so no rush to return them.
- Focusing on that task has of course prevented other things from progressing and hence the need to now make time to get the North Island Station pages generated.
September 6 2022
- With further delays on starting to enter North Island data, I have pushed on to try and get the South Island more complete. Have now got all the major lines done and most of the branch line, a few smaller ones still to go. This time round I concentrated on page functionality (Anchors, Trails and Categories) leaving the Archive data to a second pass as it was quite a different process. Paid work is getting in the way again so progress will inevitably slow down once more.
August 13 2022
- It continues to be a period of far too little time available to make real progress, at least visible progress. Having had to deal with a good bout of Covid hasn't helped either, but I do continue to make headway on two fronts.
- I have spent far too long double checking things for the NIMT, but have now committed to populating pages. The Auckland Metro scene is an ever changing beast and I have decided to not try and make provision for additional stations that are not built yet, as this was becoming very confusing around Drury which has already had a station in 3 different locations (which are now all closed) and is to get two new ones in the years ahead. I am currently preparing the last blocks of data that are needed to allocate the various pages to the correct categories and providing the correct Trail data.
- We are well on the way to providing the Library functionality we want. Currently we can add Books, Book Series, Magazines, Magazine Editions, Authors, and Publishers. The next stage is to make this all user friendly via a few action buttons rather than rely on users having to know the raw Wiki functions that we have used to enter the initial data.
July 20 2022
- Have completed an accurate representation of the North Island Network. Now the large task of populating all the pages with Trail and Category data.
- I have prepared all the NIMT data so you should see that grow over the coming weeks, and before the NIMT is finished, I will have data for some other Line prepared. So steady progress from here on.
- I am aware that there is still some data to finish on the South Island diagram, a few minor lines and junctions.
June 3 2022
- Still nowhere near enough time available to enter much needed data. However, I have got a first cut of the North Island Network Diagram prepared. It can be found using the link at the bottom of the main Page.
- Its structure was quite a bit different from the South Island and a number of new coding styles have had to be developed, which all takes time.
- This is still very much a first draft with a number of things still to resolve so you will have to bear with me there. One thing this has achieved though is the links to all the stations, so I will start preparing some of the functionality that needs to go on those pages.
- I have also been spending a fair bit of time trying to fully understand the Publications and Images part of the wiki. This is proving far more complex than I had first envisaged, but am now getting to the point of documenting the data table that will be required and their structure and interactions. That will remain a background task as I get into sorting out the North Island page functionality.
May 8 2022.
- With a request to help out with some inspection work on the real railway, I have had little time to add data., but keep plugging away at bits in the background.
- I have caught the gremlins in the South Island Network Diagram but not formally updated the page yet. You can access the draft South Island Update via a link at the bottom of the Main Page.
- I have made significant progress with the North Island Network diagram which is currently undergoing testing before a first release in a couple of weeks. Developing the layout for that has had me rethink some sections of the South Island again but i will not make any major changes there in the meantime.
- I have also spent significant time on the area of Publications. This was both to get a semblance of order into my own physical library, as well as to better understand how publications will be managed within the wiki. Further details can be found on the Publications wiki page.
March 18 2022.
- The past 4 weeks have seen steady progress on adding data. A good number more branch lines have had the Station Archive data, Trails and Anchors added, as well as Junction stations having a functional Junction Trail. All Junctions on the Main North and Main South Lines have been added.
- I had hoped to have an updated South Island Network Diagram ready but a few gremlins have crept in and it is better in the long run to deal with those properly now, than keeping on compromising.
- I have made a start on the North Island Network Diagram, so hope to be able to stick to my target of June for its release.
- While officially retired, I have been asked to help out with some deadline work over the coming months that will limit the time I can dedicate to wiki building, so keen to know if there is anyone out there willing to help.
- In the background we are attempting to understand how best to tackle some of the bigger issues around the other major pages we still need to develop. The format of Station pages is firming up but we need to very soon get error logging working, as well as info submission and Published references.
- A lot of pages include hard data, and wiki's are renown for not handling data well, so that is the other area we are spending some time on. The system we adopt early on will have a big bearing on how we can make use of data later
February 22 2022. The site went live today, though with a minimum of functionality, to give prospective users a feel of what will be available. This will hopefully be sufficient to entice you to become involved one way or another
- The South Island Network Diagram is operational barring a few possible errors in links to specific pages, please report any you find.
- Most of the major Lines are reasonably fully populated with a Line page, Track Section pages, Station pages and the File Records pages for those Stations added. It gives some idea of the extent I intend to complete each. The completed Lines include: Nelson Section, Main North Line, Main South Line, Midland Line, Otago Central Line, Catlins River Branch, Southbridge Branch and Little River Branch. Additions are being made daily.
- I have also started writing up a page for the Nelson Section as a whole, (accessible from the blue Line-name link on the Network Diagram, or searching for 'Nelson Section'). These pages are designed to hold information about the construction of the line and usually also its deconstruction.
- There is a lot of work in preparing the maps for the Lines pages, but I am now well through mapping the whole South Island in Google Earth. As time allows, additional Lines pages will be developed
- A start has also been made on writing up a concise story on the early development of the South Island railways. This is accessible from the Main page.
- Specific functionality that is working on the Station and Track-section pages that have been readied includes:
- Breadcrumbs: At the top of the page you find a row listing the 5 most recent pages you have accessed. This is an easier way to go back to an earlier page than using the browser's back button.
- Tabs: there are 6 additional tabs at the top of each page (7 on Station pages) to enable quick access to associated information, one or two more may still be added. Only the File Records Tab is being populated as part of the data load.
- Anchors: These allow you to go the matching station or section cell on the Network Diagram without needing to scroll from the top left corner. The cell you have requested will always be on the top row, usually at the right hand corner.
- Trails: This is a unique bit of coding that displays a diagram of the Stations and Track-sections either side of the current Station, with links to enable you to jump to them. This is also a significant block of work and there is still some tidying-up to do on these. Solid lines represent railways that exist, dotted lines are therefore railways that no longer exist.
Once the primary tasks are completed for all the South Island Stations, we will move on to developing the North Island Network Diagram to get that to a usable stage. The lessons learned on the South Island Diagram, will help to speed that process up considerably. At this stage I have tentatively set June as a target for getting the North Island Diagram live. If you are interested in some of the details of data loading, you can find the table I use to keep track of what is, and still needs doing here. I maintain the data in a spreadsheet which I will copy over from time to time.
By going live we of course hope to generate a lot of interest, which could generate a lot of inquiries. These will need some priority attention, but that will hopefully still leave us enough time to keep the project as a whole moving forward. As hinted in a number of places, we would welcome assistance, particularly from those that might have some wiki skills.