Sharepoint 2007 to foswiki migration project part 1

I’ve spent the last few days working on getting data out of Sharepoint Wiki, and its shocking. If you read the webservices API and believe it, things would be simple.

I’ve spent the last few days working on getting data out of Sharepoint Wiki, and its shocking. If you read the webservices API and believe it, things would be simple. Sadly, its got some pretty major bugs, and some pretty woeful architecture too.

The worst finding is that although Sharepoint lists have a webservice API to get versioned data, its broken – all versions of the MetaInfo return the text of the last revision. So I had to resort to brute force html GET’s and parsing the html to try to get the historical info.

Still, data gathered and saved – next week I’ll start trying to extract the valuable user written text from the masses of shoddy html (like in MS Word to html, every line is surrounded by the same 100 character css styles, setting font to Verdana etc.

simplest remote git repo howto (1.5 steps)

There seem to be lots of multi-step, ssh to the server style instructions how to create a new remote repository, and then push to it, but they’re all much more complex than git init.

I have many many local repositories that I decided to backup on my server, and then I can push&pull from them from my other computers too.

so – to the 1.5 steps:

0.5 create a new script called ‘create_backup.sh’ (customizing the $ssh_setting value for your ssh-able server)

#!/bin/sh

ssh_setting='user@your_server.net:~/git'
if [ -z $1 ]; then
    echo "usage: ./create_backup.sh RepoDir"
else
    scp -r  $1/.git $ssh_setting/$1
    cd $1
    git config --add alias.backup "push --mirror $ssh_setting/$1"
    ssh fosiki@fosiki.net "cd git/$1 && git config --bool core.bare true"
    git config remote.backup.url $ssh_setting/$1/
    git backup
    cd ..
fi

1. You can then run ./create_backup.sh YourLiveRepo which will create a full (but bare) copy of your repository, and add an alias that will allow you to run git backup to mirror all changes on all local branches to the backup.

The script also creates a remote.backup link that you can push and pull from in case you’re then going to clone that repo like a ‘normal’ ssh based remote.

On one local computer I can thus create a new shareable repository by running

create_backup.sh NodeJSProject

and then my new coworker can then clone it and start pushing updates:

git clone user@yourserver:~/git/NodeJsProject1



Almost a week after LCA2011 is finished….

and I still have 300 browser tabs open from the small proportion of talks I wanted to go to.

Open source conferences are astounding, hyper-rich information funnels, where hundreds of bright, enthused people open each other’s eyes to little details and big projects that  can help us do more.

wow – I hope I can find the time to go to LCA2012 in Ballarat next year.

Thankyou everyone for a really fun LCA2011 in Brisbane

Google’s DataWiki experiment

Google Labs has just added DataWiki – it looks like one of the features Foswiki (and its parent) have been doing for 10 years…

Google Labs has just added a GoogleAppEngine based Java application called – DataWiki.

So far, project information is very minimal, but it looks like one of the features Foswiki (and its parent) have been doing for 10 years…

The timing is excellent, as I’ve been working with others in the Foswiki Community to improve Foswiki’s mashup-ability:

enable easy input/output from a variety of endpoints, e.g. via Twitter, ODK or SMS from a remote location

Right now we’re working on a proper REST API for foswiki data – enabling us to retrieve and save changes to datasets in formats that are convenient to the external endpoints – and to simplify the development to dynamic visualisation and editing tools for complex data.

Perhaps what we’re looking at is a combination of the acquired and shut down JotSpot, and a response to Yahoo Pipes 🙂

Foswiki is an extremely mature (10 years) DataWiki capable enterprise wiki, with significant traction in workplaces around the world, and a strong, motivated developer and user community.

Edit foswiki files in Microsoft Office

Using the WebDAV for foswiki Extension, you can seamlessly edit Microsoft Office files in Word, Excel and Powerpoint, and then save directly back into the Wiki.

editing is easy
Kontextwork WebDAV

Using the WebDAV for foswiki Extension, you can seamlessly edit Microsoft Office files in Word, Excel and Powerpoint, and then save directly back into the Wiki.

Using WebDAV, users can get direct access to Wiki topics and attachments, via the WebDAV URL – making it possible to attach documents by drag and dropping them directly in Windows Explorer.

Some technical details

WebDAV for foswiki requires advanced libraries on the server – including Apache 2 mod_perl support. For full integration mode, some trust settings need to be changed in Internet Explorer, or an extension installed to Firefox.

Required Perl modules and extensions
  • APR::Table
  • APR::UUID
  • Apache2::Access
  • Apache2::Const
  • Apache2::Module
  • Apache2::RequestIO
  • Apache2::RequestRec
  • Data::Dumper
  • Encode
  • File::Find::Rule::Filesys::Virtual
  • File::Spec
  • POSIX
  • URI
  • URI::Escape
  • XML::LibXML => than 1.64 (declaredPrefix function is needed)
  • XML::Simple
  • Filesys::Virtual
  • POSIX
  • File::Path
  • JSON

Foswiki::Plugins::JQueryPlugin

New Dynamic jquery mb.Menus for foswiki

I’ve just started work adding Matteo Bicocchi’s rather stunning mb.Components – starting with mb.Menu. Along the way, adding foswiki Macro’s to make it simpler for us to use, I’ve also made some changes to the code (which hopefully I can get integrated into an mb.Menu release) that I have attached to the live demo.

Here’s the all important Screenie:

foswiki for windows updated to version 1.0.8

foswiki 1.0.8 and windows installer released

I built and uploaded foswiki 1.0.8 installer for windows last night – hope you like it, cos i’ll be on holidays for a few days 🙂

For the last 2 weeks I’ve been working on an SAP connector for foswiki – I can display most SAP Tables, and call most SAP functions – all via ‘RFC’ – right now we’re working towards a proactive system healthcheck report, but it pretty much will allow us to build any SAP process right into foswiki. Cool huh.

and for fun I’ve been working on making a replacement DocumentGraphics icon set based on FamFamFamContrib for foswiki – the 10 year old hand drawn one really is dated.

foswiki – wow.

Our project fork hit the one year milestone a week or so ago, and Arthur noticed this amazing ‘factoid’ on ohloh..

Very large, active development team

Over the past twelve months, 36 developers contributed new code to Foswiki.

This is one of the largest open-source teams in the world, and is in the top 2% of all project teams on Ohloh.

For this measurement, Ohloh considered only recent changes to the code. Over the entire history of the project, 43 developers have contributed.

All I can say, is WOW and thank you, to everyone that has worked on our project, and to all who discover it.

The Foswiki Association & Summit is happening in Hannover at the end of this month – I wish I could be there, but its a long way from Australia – maybe next year 🙂

I’ve been working on a Foswiki User administration user interface again

This iteration I’ve been working using the HTTPDUserAdminContrib – as having the users and groups in the database makes it hard to work on.

UserManagementUI

Hopefully there’ll be time to use and extend it for foswiki 1.1

Foswiki 1.0.7 on a USB Stick

FoswikiOnAStick

I’ve updated the USB Foswiki to include foswiki 1.0.7, and updated the systray controller to be a little more slick 🙂

I’m still looking for feedback from users – Its a nice fast way to try out foswiki without needing to install anything – just unzip the archive into the root of a disk, and click start_foswiki.bat (on Windows XP the autorun should start that automatically for you)