| ... | ... |
@@ -48,24 +48,29 @@ Create environment variable `JAVA_HOME`: |
| 48 | 48 |
|
| 49 | 49 |
### Errors |
| 50 | 50 |
|
| 51 |
-be aware that during execution a message |
|
| 52 |
- |
|
| 53 |
-`Error in .jcall("RJavaTools", "Ljava/lang/Object;", "invokeMethod", cl, : org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 7.0 failed 1 times, most recent failure: Lost task 0.0 in stage 7.0 (TID 59, localhost, executor driver): java.io.IOException: (null) entry in command string: null chmod 0644`
|
|
| 54 |
- |
|
| 55 |
-may arise in some circustances . |
|
| 56 |
- |
|
| 57 |
-This happens because some binary files are missing for Windows, in this case we need to: |
|
| 51 |
+Be aware that during a local-processing execution an error message |
|
| 52 |
+```{
|
|
| 53 |
+Error in .jcall("RJavaTools", "Ljava/lang/Object;", "invokeMethod", cl,
|
|
| 54 |
+: org.apache.spark.SparkException: Job aborted due to stage failure: |
|
| 55 |
+Task 0 in stage 7.0 failed 1 times, most recent failure: |
|
| 56 |
+Lost task 0.0 in stage 7.0 (TID 59, localhost, executor driver): |
|
| 57 |
+java.io.IOException: (null) entry in command string: null chmod 0644 |
|
| 58 |
+``` |
|
| 59 |
+may arise. |
|
| 60 |
+ |
|
| 61 |
+This happens because some Hadoop binary files are missing in Windows 64Bits. |
|
| 62 |
+In this case we need to: |
|
| 58 | 63 |
|
| 59 | 64 |
* Open [DownGit](https://minhaskamal.github.io/DownGit/#/home) |
| 60 |
-* Paste the url `https://github.com/steveloughran/winutils/tree/master/hadoop-2.8.1` in above website, and download the **winutil-hadoop2.8.1** |
|
| 65 |
+* Paste the url `https://github.com/steveloughran/winutils/tree/master/hadoop-2.8.1` and download the **winutil-hadoop2.8.1** |
|
| 66 |
+* Create a directory (for example at ```C:\Program Files\hadoop\bin```. Use a path you wish |
|
| 67 |
+* Copy the files from the repository folder **hadoop-2.8.1** into the folder earlier created. |
|
| 68 |
+* Create environment variable HADOOP_HOME with value equal to the folder path you copied the binaries. |
|
| 61 | 69 |
|
| 62 | 70 |
or |
| 63 | 71 |
|
| 64 |
-* Go to https://github.com/steveloughran/winutils and download the repo and use **winutil-hadoop2.8.1** |
|
| 65 |
- |
|
| 66 |
- |
|
| 67 |
-* Create a directory (example `C:\Program Files\hadoop`) with a folder inside named `bin` |
|
| 68 |
-* Get those files and copy them inside the bin subfolder, (copy on `C:\Program Files\hadoop\bin`) |
|
| 69 |
-* Create environment variable `HADOOP_HOME` with the path containing those files. |
|
| 70 |
- |
|
| 72 |
+* Go to [https://github.com/steveloughran/winutils](https://github.com/steveloughran/winutils), download the repository |
|
| 73 |
+* Create a directory (for example at ```C:\Program Files\hadoop\bin```. Use a path you wish |
|
| 74 |
+* Copy the files from the repository folder **hadoop-2.8.1** into the folder earlier created. |
|
| 75 |
+* Create environment variable HADOOP_HOME with value equal to the folder path you copied the binaries. |
|
| 71 | 76 |
|
| ... | ... |
@@ -815,5 +815,24 @@ a$S_00000[which(names(a$S_00000) %in% "disease")] |
| 815 | 815 |
|
| 816 | 816 |
``` |
| 817 | 817 |
|
| 818 |
+# Windows OS Issues |
|
| 819 |
+ |
|
| 820 |
+Be aware that during a [local processing](#local-processing) execution an error message |
|
| 821 |
+```{
|
|
| 822 |
+Error in .jcall("RJavaTools", "Ljava/lang/Object;", "invokeMethod", cl,
|
|
| 823 |
+: org.apache.spark.SparkException: Job aborted due to stage failure: |
|
| 824 |
+Task 0 in stage 7.0 failed 1 times, most recent failure: |
|
| 825 |
+Lost task 0.0 in stage 7.0 (TID 59, localhost, executor driver): |
|
| 826 |
+java.io.IOException: (null) entry in command string: null chmod 0644 |
|
| 827 |
+``` |
|
| 828 |
+may arise. |
|
| 829 |
+ |
|
| 830 |
+This happens because some Hadoop binary files are missing in Windows 64Bits. |
|
| 831 |
+In this case we need to: |
|
| 832 |
+ |
|
| 833 |
+* Go to [https://github.com/steveloughran/winutils](https://github.com/steveloughran/winutils), download the repository |
|
| 834 |
+* Create a directory (for example at ```C:\Program Files\hadoop\bin```. Use a path you wish |
|
| 835 |
+* Copy the files from the repository folder **hadoop-2.8.1** into the folder earlier created. |
|
| 836 |
+* Create environment variable HADOOP_HOME with value equal to the folder path you copied the binaries. |
|
| 818 | 837 |
|
| 819 | 838 |
# References |
